00000001:02000400:2.0F:1787882364.278061:0:2962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787882385.740683:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787882387.757693:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 565 MB/s 00000001:01000000:0.0F:1787882388.007546:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 843 MB/s 00000001:01000000:2.0:1787882388.257020:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4927 MB/s 00000020:02000000:0.0:1787882389.264674:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_84_gd387c42 00000400:02000000:0.0:1787882390.002660:0:3288:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.121@tcp [8/256/0/180] 00008000:02000000:2.0:1787882394.101838:0:3438:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1787882449.600418:0:5245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787882460.104023:0:5824:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787882460.104030:0:5824:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787882460.104132:0:5824:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f7b8ade0 00000080:02000400:3.0:1787882460.104142:0:5824:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787882460.109244:0:5824:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787882460.109260:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787882460.109309:0:5824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000061eed0a6) 00000020:00000080:3.0:1787882460.109333:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787882460.131771:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787882460.132202:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787882460.176866:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787882460.176941:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787882460.176965:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787882460.179850:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787882460.179958:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787882460.180366:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787882460.180374:0:5824:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787882460.180384:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5dea7f 00000020:01000004:2.0:1787882460.180392:0:5824:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787882460.180397:0:5824:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787882460.180402:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f7b8ade0 from MGS 00000020:01000004:2.0:1787882460.180407:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787882460.180424:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000423de84b) 00000020:00000080:2.0:1787882460.180437:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787882460.180547:0:5824:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f7b8ade0 from MGS, refs=2 00080000:01000000:2.0:1787882460.180553:0:5824:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787882460.180559:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5dea8d 00000100:00100000:2.0:1787882460.180654:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787882460.180803:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787882460.180809:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787882460.189711:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787882460.189733:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787882460.191382:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787882460.191664:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787882460.191671:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787882460.194267:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787882460.194283:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787882460.194990:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787882460.194998:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787882460.195665:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882460.195669:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882460.195670:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882460.206661:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882460.206669:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882460.206688:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882460.219245:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787882460.230565:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787882460.474220:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2549 MB/s 00000001:01000000:3.0:1787882460.724231:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3147 MB/s 00000001:01000000:2.0:1787882460.974706:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 427 MB/s 00000001:01000000:3.0:1787882461.224433:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 667 MB/s 00080000:10000000:0.0:1787882461.239015:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1787882461.263660:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787882461.263681:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787882461.263683:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787882461.264698:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787882461.264771:0:5824:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787882461.264836:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787882461.265110:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787882461.265138:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787882461.265676:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787882461.266349:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787882461.266358:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787882461.274863:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787882461.274969:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787882461.275372:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787882461.275392:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787882461.275987:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787882461.276010:0:5824:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.121@tcp' 00000020:01000004:2.0:1787882461.276012:0:5824:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787882461.276064:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.121@tcp (typ=mgc) 00000020:00000080:2.0:1787882461.276077:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.121@tcp (00000000b74f529b) 00000020:00000080:2.0:1787882461.276094:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787882461.276170:0:5824:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a63e8b48@MGC192.168.206.121@tcp: add connection 192.168.206.121@tcp at head 00010000:00010000:2.0:1787882461.276328:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.121@tcp-0 is initialized 00000040:01000000:2.0:1787882461.276334:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787882461.281030:0:5839:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787882461.286336:0:5841:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787882461.286397:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.121@tcp (uuid 8fe006bc-8a96-494d-a4af-8dd699ee0b84) 00000020:00000080:2.0:1787882461.286420:0:5824:0:(genops.c:1385:class_connect()) connect: client 8fe006bc-8a96-494d-a4af-8dd699ee0b84, cookie 0xf4731e8a7c5dea9b 00000100:00080000:2.0:1787882461.286432:0:5824:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787882461.286437:0:5824:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import 00000000a63e8b48 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1787882461.286493:0:5824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003d623573 x1874730563928192/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787882461.286513:0:5824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8fe006bc-8a96-494d-a4af-8dd699ee0b84->MGS 00000020:01000004:2.0:1787882461.286529:0:5824:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787882461.286535:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787882461.286549:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e4496b8b) 00000020:00000080:2.0:1787882461.286562:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787882461.291503:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d623573 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3304:1874730563928192:0@lo:250: 00000100:00100000:0.0:1787882461.291610:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787882461.293754:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882461.293854:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563928192 00000100:00100000:3.0:1787882461.293866:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563928192 00000100:00100000:3.0:1787882461.293935:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787882461.293943:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e000e339 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1874730563928192:12345-0@lo:250: 00010000:00080000:3.0:1787882461.293973:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8fe006bc-8a96-494d-a4af-8dd699ee0b84@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1787882461.294002:0:5835:0:(genops.c:1385:class_connect()) connect: client 8fe006bc-8a96-494d-a4af-8dd699ee0b84, cookie 0xf4731e8a7c5deaa9 00000100:00080000:3.0:1787882461.294142:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000faf9e95f : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787882461.294249:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e000e339 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+5:3304:x1874730563928192:12345-0@lo:250: Request processed in 305us (2638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882461.294257:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882461.296273:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787882461.296286:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.121@tcp: connect to target with instance 0 00000100:00080000:0.0:1787882461.296294:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787882461.296299:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787882461.296303:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000a63e8b48 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787882461.296307:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787882461.296317:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787882461.296323:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d623573 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3304:1874730563928192:0@lo:250: 00000100:00100000:3.0:1787882461.320440:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787882461.320686:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787882461.320693:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787882461.322299:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787882461.322315:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787882461.322719:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787882461.322725:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787882461.324216:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787882461.324403:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787882461.324409:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787882461.327411:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787882461.327427:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787882461.436981:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787882461.437211:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787882461.437218:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787882461.439775:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787882461.439800:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787882461.441443:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787882461.441635:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787882461.441641:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787882461.442368:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787882461.442376:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787882461.444245:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787882461.444426:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787882461.444432:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787882461.445394:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787882461.445404:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787882461.446009:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787882461.446180:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787882461.446185:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787882461.447131:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787882461.447140:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787882461.491897:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882461.492124:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787882461.492131:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787882461.499426:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787882461.499450:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787882461.500296:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787882461.500306:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787882461.501601:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787882461.501629:0:5824:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787882461.501637:0:5824:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787882461.501789:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787882461.501828:0:5824:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.121@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1787882461.501832:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787882461.501834:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787882461.501835:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882461.501836:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882461.501837:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882461.501839:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882461.501840:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787882461.501841:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787882461.501843:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787882461.501844:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787882461.501846:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882461.501847:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787882461.501850:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1787882461.501852:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787882461.501853:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787882461.501854:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882461.501855:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882461.501856:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882461.501857:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882461.501858:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787882461.501859:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787882461.501860:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787882461.501861:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787882461.501900:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882461.501901:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787882461.501930:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787882461.501948:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002ed6b026 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928320:0@lo:253: 00000100:00100000:2.0:1787882461.502048:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882461.502095:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d22e4c6 going to sleep for 11 seconds 00000100:00100000:1.0:1787882461.502177:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563928320 00000100:00100000:1.0:1787882461.502187:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563928320 00000100:00100000:1.0:1787882461.502239:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787882461.502248:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed03bd4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+5:5824:x1874730563928320:12345-0@lo:253: 20000000:01000000:1.0:1787882461.502298:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787882461.502301:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787882461.502804:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787882461.503072:0:5838:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787882461.503359:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787882461.504693:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787882461.505326:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787882461.505332:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787882461.505339:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787882461.505343:0:5838:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787882461.505360:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787882461.505669:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787882461.505937:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787882461.505950:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787882461.505997:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787882461.506050:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787882461.506087:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787882461.506182:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787882461.506190:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787882461.506248:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787882461.506256:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787882461.506288:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787882461.506295:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787882461.506327:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787882461.506387:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787882461.506421:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787882461.506426:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787882461.506438:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787882461.506628:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787882461.506639:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787882461.506674:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787882461.506725:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787882461.506775:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787882461.506798:0:5838:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787882461.506897:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787882461.506907:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787882461.506955:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787882461.506993:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787882461.507030:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787882461.507040:0:5838:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787882461.507119:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787882461.507128:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787882461.507161:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787882461.507197:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787882461.507357:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787882461.507425:0:5838:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787882461.507433:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787882461.513488:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787882461.513945:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787882461.513976:0:5838:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.121@tcp for mdt 20000000:01000000:0.0:1787882461.513978:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:0.0:1787882461.514014:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787882461.514039:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787882461.514071:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787882461.514077:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:0.0:1787882461.514119:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787882461.514130:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787882461.514163:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787882461.514195:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787882461.514276:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787882461.514280:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787882461.514285:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787882461.514297:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787882461.514300:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787882461.514329:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787882461.514331:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787882461.514934:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787882461.515289:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787882461.515338:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787882461.515376:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787882461.515400:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787882461.515403:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787882461.516135:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787882461.516472:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787882461.516511:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787882461.516574:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1787882461.516589:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787882461.516591:0:5838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1787882461.516596:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787882461.516598:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787882461.516603:0:5838:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787882461.516610:0:5838:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787882461.517278:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787882461.517484:0:5838:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787882461.531730:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787882461.531815:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787882461.531991:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787882461.532031:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787882461.532056:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000624a3311/0xf4731e8a7c5deab0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.532086:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000624a3311/0xf4731e8a7c5deab0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.532097:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000624a3311/0xf4731e8a7c5deab0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.532103:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000624a3311/0xf4731e8a7c5deab0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.532108:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000624a3311/0xf4731e8a7c5deab0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.532119:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000624a3311/0xf4731e8a7c5deab0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.532125:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000624a3311 already unused, calling callback (0000000006379d3e) 00010000:00010000:0.0:1787882461.532129:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000624a3311/0xf4731e8a7c5deab0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.532136:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000624a3311/0xf4731e8a7c5deab0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.532147:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000624a3311/0xf4731e8a7c5deab0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.532154:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000624a3311/0xf4731e8a7c5deab0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.532159:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000624a3311/0xf4731e8a7c5deab0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787882461.532189:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787882461.900499:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed03bd4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+5:5824:x1874730563928320:12345-0@lo:253: Request processed in 398243us (398442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882461.900516:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882461.900830:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002ed6b026 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928320:0@lo:253: 10000000:01000000:0.0:1787882461.900847:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787882461.900851:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787882461.900853:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787882461.900854:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787882461.900855:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787882461.900856:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787882461.900857:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787882461.900858:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787882461.900860:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787882461.900861:0:5824:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787882461.900863:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787882461.900864:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787882461.900923:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f7b8ade0 from lustre-MDT0000 10000000:01000000:0.0:1787882461.900951:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787882461.900954:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787882461.900958:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fa297fcb370 10000000:01000000:0.0:1787882461.900962:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787882461.900970:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa297fcb370 from 1 10000000:01000000:0.0:1787882461.900974:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787882461.901024:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000671c5ea3/0xf4731e8a7c5deab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.901033:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000671c5ea3/0xf4731e8a7c5deab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.901042:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000671c5ea3/0xf4731e8a7c5deab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882461.901058:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000040bcec38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928448:0@lo:101: 00000100:00100000:0.0:1787882461.901106:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882461.901151:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000005c954847 going to sleep for 11 seconds 00000100:00100000:1.0:1787882461.901242:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563928448 00000100:00100000:1.0:1787882461.901249:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563928448 00000100:00100000:1.0:1787882461.901294:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787882461.901303:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084e531e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+5:5824:x1874730563928448:12345-0@lo:101: 00010000:00010000:1.0:1787882461.901316:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882461.901332:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000250bd77a/0xf4731e8a7c5deabe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5deab7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882461.901355:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000250bd77a/0xf4731e8a7c5deabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5deab7 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882461.901365:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000250bd77a/0xf4731e8a7c5deabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deab7 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882461.901374:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000250bd77a, rc 0) 00000100:00100000:1.0:1787882461.901413:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084e531e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+6:5824:x1874730563928448:12345-0@lo:101: Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882461.901419:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787882461.901523:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000040bcec38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928448:0@lo:101: 00010000:00010000:0.0:1787882461.901536:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000671c5ea3/0xf4731e8a7c5deab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.901544:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000671c5ea3/0xf4731e8a7c5deab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882461.901604:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000040bcec38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928576:0@lo:501: 00000100:00100000:0.0:1787882461.901628:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882461.901649:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000005c954847 going to sleep for 11 seconds 00000100:00100000:1.0:1787882461.901813:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563928576 00000100:00100000:1.0:1787882461.901817:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563928576 00000100:00100000:1.0:1787882461.901848:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787882461.901854:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fef6dc5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+6:5824:x1874730563928576:12345-0@lo:501: 00000100:00100000:1.0:1787882461.902282:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fef6dc5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+6:5824:x1874730563928576:12345-0@lo:501: Request processed in 428us (652us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787882461.902291:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787882461.902355:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000040bcec38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928576:0@lo:501: 10000000:01000000:0.0:1787882461.902390:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787882461.902408:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000671c5ea3/0xf4731e8a7c5deab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.902417:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000671c5ea3/0xf4731e8a7c5deab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882461.902425:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa285a97800 10000000:01000000:0.0:1787882461.902428:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787882461.902432:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fa285a97800 10000000:01000000:0.0:1787882461.902434:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787882461.902437:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fa285a97800 from 1 10000000:01000000:0.0:1787882461.902440:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787882461.902459:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000ff0f5971/0xf4731e8a7c5deac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.902476:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000ff0f5971/0xf4731e8a7c5deac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.902484:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000ff0f5971/0xf4731e8a7c5deac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882461.902496:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000040bcec38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928704:0@lo:101: 00000100:00100000:0.0:1787882461.902523:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882461.902560:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000005c954847 going to sleep for 11 seconds 00000100:00100000:3.0:1787882461.902657:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563928704 00000100:00100000:3.0:1787882461.902664:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563928704 00000100:00100000:3.0:1787882461.902706:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787882461.902713:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005dc8567 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+6:5824:x1874730563928704:12345-0@lo:101: 00010000:00010000:3.0:1787882461.902722:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882461.902736:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001e032f67/0xf4731e8a7c5deacc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5deac5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882461.902752:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e032f67/0xf4731e8a7c5deacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5deac5 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882461.902760:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001e032f67/0xf4731e8a7c5deacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deac5 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882461.902767:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001e032f67, rc 0) 00000100:00100000:3.0:1787882461.902813:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005dc8567 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+7:5824:x1874730563928704:12345-0@lo:101: Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882461.902818:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787882461.902966:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000040bcec38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928704:0@lo:101: 00010000:00010000:0.0:1787882461.902978:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000ff0f5971/0xf4731e8a7c5deac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.902985:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000ff0f5971/0xf4731e8a7c5deac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882461.902997:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787882461.903000:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000ff0f5971/0xf4731e8a7c5deac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.903006:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000ff0f5971/0xf4731e8a7c5deac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882461.903011:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787882461.903015:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787882461.903018:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fa285a97800 10000000:01000000:0.0:1787882461.903021:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787882461.903028:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787882461.903036:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787882461.903050:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 0000000083b25780/0xf4731e8a7c5dead3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.903057:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 0000000083b25780/0xf4731e8a7c5dead3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882461.903064:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 0000000083b25780/0xf4731e8a7c5dead3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882461.903074:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000040bcec38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928832:0@lo:101: 00000100:00100000:0.0:1787882461.903099:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882461.903116:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000005c954847 going to sleep for 11 seconds 00000100:00100000:1.0:1787882461.903215:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563928832 00000100:00100000:1.0:1787882461.903220:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563928832 00000100:00100000:1.0:1787882461.903249:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787882461.903255:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000358caa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+7:5824:x1874730563928832:12345-0@lo:101: 00010000:00010000:1.0:1787882461.903262:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882461.903274:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5cc05b1/0xf4731e8a7c5deada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dead3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882461.903291:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5cc05b1/0xf4731e8a7c5deada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dead3 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882461.903298:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5cc05b1/0xf4731e8a7c5deada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dead3 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882461.903308:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5cc05b1, rc 0) 00000100:00100000:1.0:1787882461.903343:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000358caa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+8:5824:x1874730563928832:12345-0@lo:101: Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882461.903350:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787882461.903406:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000040bcec38 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928832:0@lo:101: 00010000:00010000:1.0:1787882461.903415:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 0000000083b25780/0xf4731e8a7c5dead3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882461.903422:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 0000000083b25780/0xf4731e8a7c5dead3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882461.903549:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003973336f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928960:0@lo:501: 00000100:00100000:1.0:1787882461.903649:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882461.903660:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f5d51fd going to sleep for 11 seconds 00000100:00100000:0.0:1787882461.903771:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563928960 00000100:00100000:0.0:1787882461.903775:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563928960 00000100:00100000:0.0:1787882461.909463:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787882461.909485:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005528c3ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+8:5824:x1874730563928960:12345-0@lo:501: 00000100:00100000:0.0:1787882461.911222:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005528c3ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:5824:x1874730563928960:12345-0@lo:501: Request processed in 1737us (7564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882461.911238:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787882461.912140:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003973336f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563928960:0@lo:501: 00000100:00100000:1.0:1787882461.912207:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003973336f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929088:0@lo:503: 00000100:00100000:1.0:1787882461.912311:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882461.912403:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f5d51fd going to sleep for 11 seconds 00000100:00100000:0.0:1787882461.914273:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563929088 00000100:00100000:0.0:1787882461.914289:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563929088 00000100:00100000:0.0:1787882461.914349:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787882461.914358:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000099aa17d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:5824:x1874730563929088:12345-0@lo:503: 00000100:00100000:0.0:1787882461.914603:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000099aa17d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:5824:x1874730563929088:12345-0@lo:503: Request processed in 246us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882461.914611:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787882461.914926:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003973336f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929088:0@lo:503: 00000100:00100000:1.0:1787882461.915282:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003973336f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5877:1874730563929216:0@lo:502: 00000100:00100000:1.0:1787882461.915335:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882461.915369:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d92a623d going to sleep for 11 seconds 00000100:00100000:0.0:1787882461.915428:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563929216 00000100:00100000:0.0:1787882461.915434:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563929216 00000100:00100000:0.0:1787882461.915480:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787882461.915486:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008704ea73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:5877:x1874730563929216:12345-0@lo:502: 00000100:00100000:0.0:1787882461.916150:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008704ea73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:5877:x1874730563929216:12345-0@lo:502: Request processed in 663us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882461.916161:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787882461.918603:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003973336f pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5877:1874730563929216:0@lo:502: 00000020:01000000:1.0:1787882461.918661:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882461.918684:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882461.918687:0:5877:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787882461.918693:0:5877:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787882461.918696:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787882461.918726:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e0a63a49) 00000020:00000080:1.0:1787882461.918902:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787882461.918909:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787882461.919033:0:5877:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787882461.919041:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5deae8 00000020:00000080:1.0:1787882461.919272:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787882461.919276:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882461.919279:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882461.919286:0:5877:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787882461.919289:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882461.919293:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882461.919295:0:5877:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787882461.919298:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787882461.919304:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000046bd6616) 00000020:00000080:1.0:1787882461.919313:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787882461.919316:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787882461.919318:0:5877:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787882461.919321:0:5877:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787882461.919327:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787882461.919370:0:5877:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f7b8ade0 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787882461.919381:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000064eda0a1) 00000020:00000080:1.0:1787882461.919388:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787882461.919443:0:5877:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787882461.919448:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4731e8a7c5deafd 00000020:00000080:1.0:1787882461.919537:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787882461.919543:0:5877:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787882461.919548:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf4731e8a7c5deb04 00080000:01000000:1.0:1787882461.919659:0:5877:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787882461.919662:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5deb0b 00080000:10000000:1.0:1787882461.920254:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787882461.920476:0:5877:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787882461.928543:0:5877:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1787882462.084543:0:5877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787882462.085402:0:5877:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787882462.089000:0:5877:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787882462.089438:0:5877:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787882462.151419:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a3af108a) 00000020:00000080:2.0:1787882462.151440:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787882462.151513:0:5877:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787882462.151519:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5deb19 00000020:00000080:2.0:1787882462.155150:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787882462.158138:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787882462.221281:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787882462.252232:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787882462.287760:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:0.0:1787882462.314503:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787882462.342150:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787882462.385355:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1787882462.453384:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf4731e8a7c5deb20 00000020:00000080:3.0:1787882462.454142:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787882462.454157:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882462.454165:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882462.454168:0:5877:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787882462.454171:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882462.454175:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882462.454176:0:5877:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787882462.454179:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787882462.454181:0:5877:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787882462.454184:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882462.454186:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882462.454187:0:5877:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787882462.454189:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882462.454193:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882462.454194:0:5877:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787882462.454199:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787882462.454247:0:5877:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1787882462.454347:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fc33e1d pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5877:1874730563929344:0@lo:502: 00000100:00100000:3.0:1787882462.454438:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882462.454490:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c18184d2 going to sleep for 11 seconds 00000100:00100000:2.0:1787882462.454627:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563929344 00000100:00100000:2.0:1787882462.454634:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563929344 00000100:00100000:2.0:1787882462.454680:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787882462.454689:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000926312f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:5877:x1874730563929344:12345-0@lo:502: 00000100:00100000:2.0:1787882462.455115:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000926312f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:5877:x1874730563929344:12345-0@lo:502: Request processed in 427us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882462.455124:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787882462.455833:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fc33e1d pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5877:1874730563929344:0@lo:502: 00000020:01000000:3.0:1787882462.455910:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882462.455918:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882462.455920:0:5877:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787882462.455924:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787882462.457628:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787882462.457658:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787882462.457679:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 0000000083b25780/0xf4731e8a7c5dead3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882462.457692:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 0000000083b25780/0xf4731e8a7c5dead3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882462.457700:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa285a97800 from 1 10000000:01000000:2.0:1787882462.457717:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787882462.457758:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882462.457767:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882462.457789:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882462.457812:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020735849 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929472:0@lo:101: 00000100:00100000:2.0:1787882462.457912:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882462.457949:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e4cd8c7 going to sleep for 11 seconds 00000100:00100000:0.0:1787882462.458095:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563929472 00000100:00100000:0.0:1787882462.458103:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563929472 00000100:00100000:0.0:1787882462.458137:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787882462.458143:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bca96ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:5824:x1874730563929472:12345-0@lo:101: 00010000:00010000:0.0:1787882462.458155:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882462.458167:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f8c71cd/0xf4731e8a7c5deb2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5deb27 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.458187:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f8c71cd/0xf4731e8a7c5deb2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb27 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.458196:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f8c71cd/0xf4731e8a7c5deb2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb27 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.458204:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f8c71cd, rc 0) 00000100:00100000:0.0:1787882462.458292:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bca96ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+10:5824:x1874730563929472:12345-0@lo:101: Request processed in 148us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882462.458299:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787882462.462102:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020735849 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929472:0@lo:101: 00010000:00010000:1.0:1787882462.462132:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882462.462144:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882462.462735:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003973336f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929600:0@lo:256: 00000100:00100000:1.0:1787882462.462828:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882462.463469:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ebc1e2da going to sleep for 11 seconds 00000100:00100000:0.0:1787882462.467662:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563929600 00000100:00100000:0.0:1787882462.467680:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563929600 00000100:00100000:0.0:1787882462.467748:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787882462.467757:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065ddf20f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+10:5824:x1874730563929600:12345-0@lo:256: 20000000:01000000:0.0:1787882462.467794:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787882462.467800:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787882462.468112:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065ddf20f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+10:5824:x1874730563929600:12345-0@lo:256: Request processed in 355us (5282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882462.468121:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787882462.469817:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003973336f pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929600:0@lo:256: 10000000:01000000:2.0:1787882462.470797:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787882462.470939:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882462.470952:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882462.471044:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa285a97800 from 1 10000000:01000000:3.0:1787882462.471049:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787882462.471096:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882462.471116:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882462.471126:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882462.471150:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fc33e1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929728:0@lo:101: 00000100:00100000:3.0:1787882462.471219:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882462.471286:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c18184d2 going to sleep for 11 seconds 00000100:00100000:2.0:1787882462.471650:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563929728 00000100:00100000:2.0:1787882462.471658:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563929728 00000100:00100000:2.0:1787882462.471714:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787882462.471723:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000722e8bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+10:5824:x1874730563929728:12345-0@lo:101: 00010000:00010000:2.0:1787882462.471737:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882462.471755:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000db50e4f1/0xf4731e8a7c5deb3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5deb35 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882462.471804:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000db50e4f1/0xf4731e8a7c5deb3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb35 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882462.471814:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000db50e4f1/0xf4731e8a7c5deb3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb35 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882462.471823:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000db50e4f1, rc 0) 00000100:00100000:2.0:1787882462.471906:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000722e8bf2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:5824:x1874730563929728:12345-0@lo:101: Request processed in 184us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882462.471913:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787882462.472068:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fc33e1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929728:0@lo:101: 00010000:00010000:3.0:1787882462.472083:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882462.472091:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882462.472147:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fc33e1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929856:0@lo:501: 00000100:00100000:3.0:1787882462.472176:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882462.472200:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c18184d2 going to sleep for 11 seconds 00000100:00100000:0.0:1787882462.472322:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563929856 00000100:00100000:0.0:1787882462.472328:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563929856 00000100:00100000:0.0:1787882462.472364:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787882462.472371:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e7ecbaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:5824:x1874730563929856:12345-0@lo:501: 00000100:00100000:0.0:1787882462.475287:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e7ecbaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:5824:x1874730563929856:12345-0@lo:501: Request processed in 2911us (3104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882462.475303:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787882462.475465:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fc33e1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929856:0@lo:501: 00000100:00100000:3.0:1787882462.475523:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fc33e1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929984:0@lo:503: 00000100:00100000:3.0:1787882462.475576:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882462.475618:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c18184d2 going to sleep for 11 seconds 00000100:00100000:2.0:1787882462.475815:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563929984 00000100:00100000:2.0:1787882462.475823:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563929984 00000100:00100000:2.0:1787882462.475888:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787882462.475897:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099818834 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:5824:x1874730563929984:12345-0@lo:503: 00000040:00080000:2.0:1787882462.475941:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787882462.475983:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099818834 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:5824:x1874730563929984:12345-0@lo:503: Request processed in 88us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882462.475990:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787882462.476122:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fc33e1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563929984:0@lo:503: 00000040:00080000:2.0:1787882462.477089:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787882462.477152:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787882462.477187:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787882462.481452:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882462.481472:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882462.481560:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787882462.481647:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa285a97800 10000000:01000000:2.0:1787882462.481650:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa285a97800 10000000:01000000:2.0:1787882462.481655:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787882462.481662:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa285a97800 from 1 10000000:01000000:2.0:1787882462.481665:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787882462.481703:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000c22031d8/0xf4731e8a7c5deb43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882462.481712:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000c22031d8/0xf4731e8a7c5deb43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882462.481723:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000c22031d8/0xf4731e8a7c5deb43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882462.481747:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a7b657b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563930112:0@lo:101: 00000100:00100000:2.0:1787882462.481829:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882462.481950:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000384429a1 going to sleep for 11 seconds 00000100:00100000:0.0:1787882462.485514:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563930112 00000100:00100000:0.0:1787882462.485530:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563930112 00000100:00100000:0.0:1787882462.485594:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787882462.485604:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099d24ff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:5824:x1874730563930112:12345-0@lo:101: 00010000:00010000:0.0:1787882462.485622:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882462.485641:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003bbd8a79/0xf4731e8a7c5deb4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5deb43 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.485671:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bbd8a79/0xf4731e8a7c5deb4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb43 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.485683:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003bbd8a79/0xf4731e8a7c5deb4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb43 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.485715:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003bbd8a79, rc 0) 00000100:00100000:0.0:1787882462.485811:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099d24ff8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5824:x1874730563930112:12345-0@lo:101: Request processed in 208us (3982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882462.485819:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787882462.486378:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a7b657b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563930112:0@lo:101: 00010000:00010000:2.0:1787882462.486398:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000c22031d8/0xf4731e8a7c5deb43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882462.486408:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000c22031d8/0xf4731e8a7c5deb43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882462.486482:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002a7b657b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563930240:0@lo:501: 00000100:00100000:2.0:1787882462.486520:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882462.486567:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000384429a1 going to sleep for 11 seconds 00000100:00100000:0.0:1787882462.487349:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563930240 00000100:00100000:0.0:1787882462.487357:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563930240 00000100:00100000:0.0:1787882462.487407:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787882462.487415:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e32b30f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5824:x1874730563930240:12345-0@lo:501: 00000100:00100000:0.0:1787882462.487741:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e32b30f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5824:x1874730563930240:12345-0@lo:501: Request processed in 326us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882462.487749:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787882462.488459:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002a7b657b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563930240:0@lo:501: 00000100:00100000:3.0:1787882462.488520:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fc33e1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563930368:0@lo:503: 00000100:00100000:3.0:1787882462.488572:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882462.488653:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000005427aafe going to sleep for 11 seconds 00000100:00100000:0.0:1787882462.488711:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563930368 00000100:00100000:0.0:1787882462.488717:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563930368 00000100:00100000:0.0:1787882462.488756:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787882462.488764:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c38aa48a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5824:x1874730563930368:12345-0@lo:503: 00000100:00100000:0.0:1787882462.489110:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c38aa48a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5824:x1874730563930368:12345-0@lo:503: Request processed in 347us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882462.489118:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787882462.489244:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fc33e1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563930368:0@lo:503: 00000100:00100000:2.0:1787882462.489644:0:5885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a2ad51d pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5885:1874730563930496:0@lo:502: 00000100:00100000:2.0:1787882462.489691:0:5885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882462.489723:0:5885:0:(client.c:2715:ptlrpc_set_wait()) set 00000000383565ce going to sleep for 11 seconds 00000100:00100000:1.0:1787882462.489784:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563930496 00000100:00100000:1.0:1787882462.489790:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563930496 00000100:00100000:1.0:1787882462.489824:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787882462.489831:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3f4f84d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5885:x1874730563930496:12345-0@lo:502: 00000100:00100000:1.0:1787882462.490065:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3f4f84d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5885:x1874730563930496:12345-0@lo:502: Request processed in 235us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882462.490073:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787882462.490164:0:5885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a2ad51d pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5885:1874730563930496:0@lo:502: 00000020:01000004:2.0:1787882462.490222:0:5885:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787882462.490248:0:5885:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000009e81d5a6) 00000020:00000080:2.0:1787882462.490266:0:5885:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787882462.490350:0:5885:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f7b8ade0 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787882462.490355:0:5885:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f7b8ade0 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787882462.490357:0:5885:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f7b8ade0 4 00010000:00080000:2.0:1787882462.490395:0:5885:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000a9b02b9@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:2.0:1787882462.492239:0:5885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787882462.496572:0:5885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787882462.496628:0:5885:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787882462.496642:0:5885:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf4731e8a7c5deb58 00000100:00080000:2.0:1787882462.496655:0:5885:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787882462.496660:0:5885:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000a9b02b9 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1787882462.496697:0:5885:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004a2ad51d x1874730563930624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787882462.496753:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004a2ad51d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874730563930624:0@lo:38: 00000100:00100000:0.0:1787882462.496837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787882462.498844:0:5885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787882462.502574:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563930624 00000100:00100000:0.0:1787882462.502590:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563930624 00000100:00100000:0.0:1787882462.502642:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882462.502651:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007dff5934 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874730563930624:12345-0@lo:38: 00000100:00100000:0.0:1787882462.502755:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007dff5934 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874730563930624:12345-0@lo:38: Request processed in 105us (5919us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787882462.502792:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882462.502843:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787882462.502853:0:3304:0:(import.c:65:import_set_state_nolock()) 000000000a9b02b9 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787882462.502858:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787882462.502861:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004a2ad51d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874730563930624:0@lo:38: 00000100:00100000:2.0:1787882462.504206:0:5885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e1a9b102 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5885:1874730563930752:0@lo:502: 00000100:00100000:2.0:1787882462.504291:0:5885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882462.504346:0:5885:0:(client.c:2715:ptlrpc_set_wait()) set 0000000098796df4 going to sleep for 11 seconds 00000100:00100000:0.0:1787882462.504396:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563930752 00000100:00100000:0.0:1787882462.504403:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563930752 00000100:00100000:0.0:1787882462.504451:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787882462.504459:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081658a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5885:x1874730563930752:12345-0@lo:502: 00000100:00100000:0.0:1787882462.504703:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081658a9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5885:x1874730563930752:12345-0@lo:502: Request processed in 245us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882462.504711:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787882462.504762:0:5885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e1a9b102 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5885:1874730563930752:0@lo:502: 00000040:00080000:0.0:1787882462.504799:0:5885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787882462.506209:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787882462.506241:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787882462.506262:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000c22031d8/0xf4731e8a7c5deb43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882462.506274:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000c22031d8/0xf4731e8a7c5deb43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787882462.506337:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787882462.506339:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787882462.506340:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787882462.506341:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787882462.506342:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787882462.506344:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787882462.506345:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787882462.506347:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787882462.506348:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787882462.506349:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787882462.506351:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787882462.506352:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787882462.506362:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787882462.506365:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787882462.506366:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787882462.506367:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787882462.506368:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787882462.506369:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787882462.506370:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787882462.506370:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787882462.506371:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787882462.506372:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787882462.506373:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787882462.506374:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787882462.506375:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787882462.506400:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787882462.506416:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003ecc9af pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563930880:0@lo:253: 00000100:00100000:1.0:1787882462.506482:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882462.506517:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dd77fa28 going to sleep for 11 seconds 00000100:00100000:2.0:1787882462.506972:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563930880 00000100:00100000:2.0:1787882462.506982:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563930880 00000100:00100000:2.0:1787882462.507032:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787882462.507040:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a7274f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5824:x1874730563930880:12345-0@lo:253: 20000000:01000000:2.0:1787882462.507069:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787882462.507092:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787882462.590820:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787882462.590841:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787882462.590969:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787882462.590975:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787882462.591007:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882462.591027:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005f8c71cd/0xf4731e8a7c5deb2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb27 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882462.591045:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882462.591089:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005f8c71cd/0xf4731e8a7c5deb2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5deb27 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882462.591104:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005f8c71cd/0xf4731e8a7c5deb2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb27 expref: 12 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882462.591120:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f2fc079 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874730563931008:0@lo:104: 00000100:00100000:1.0:1787882462.591206:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882462.591272:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f4fc802b going to sleep for 11 seconds 00000100:00100000:0.0:1787882462.591403:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563931008 00000100:00100000:0.0:1787882462.591412:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563931008 00000100:00100000:0.0:1787882462.591467:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882462.591475:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081ed18ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5860:x1874730563931008:12345-0@lo:104: 00010000:00010000:0.0:1787882462.591488:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.591542:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787882462.591558:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081ed18ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5860:x1874730563931008:12345-0@lo:104: Request processed in 74us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882462.591565:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882462.591625:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f2fc079 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874730563931008:0@lo:104: 00010000:00010000:0.0:1787882462.591642:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.591658:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882462.591663:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.591669:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000335351be already unused, calling callback (00000000eb656bbb) 10000000:00010000:0.0:1787882462.591672:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.591678:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787882462.591684:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882462.591690:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787882462.591714:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.591721:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787882462.591736:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.591742:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: 00000000335351be/0xf4731e8a7c5deb27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.591759:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882462.591761:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882462.591768:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882462.591841:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000163cb4c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563931136:0@lo:103: 00000100:00100000:0.0:1787882462.591905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882462.591970:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563931136 00000100:00100000:0.0:1787882462.591974:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563931136 00010000:00010000:0.0:1787882462.591988:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005f8c71cd/0xf4731e8a7c5deb2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb27 expref: 13 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882462.592008:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882462.592013:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e759f3d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:3306:x1874730563931136:12345-0@lo:103: 00010000:00010000:0.0:1787882462.592022:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882462.592026:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005f8c71cd/0xf4731e8a7c5deb2e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb27 expref: 13 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592217:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005f8c71cd/0xf4731e8a7c5deb2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb27 expref: 13 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592230:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005f8c71cd/0xf4731e8a7c5deb2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5deb27 expref: 13 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592242:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592248:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787882462.592262:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001288002s 00010000:00010000:0.0:1787882462.592265:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592271:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592281:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592286:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592291:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000736a7813 already unused, calling callback (0000000006379d3e) 00010000:00010000:0.0:1787882462.592294:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592299:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592310:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592319:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882462.592344:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e759f3d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3306:x1874730563931136:12345-0@lo:103: Request processed in 331us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882462.592351:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787882462.592370:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592376:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882462.592381:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000736a7813/0xf4731e8a7c5deb5f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882462.592405:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000163cb4c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563931136:0@lo:103: 00000100:00100000:0.0:1787882462.603512:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a7274f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:5824:x1874730563930880:12345-0@lo:253: Request processed in 96463us (97021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882462.603530:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787882462.603658:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003ecc9af pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5824:1874730563930880:0@lo:253: 10000000:01000000:2.0:1787882462.603677:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787882462.603680:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787882462.603683:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787882462.603684:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882462.603685:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882462.603686:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882462.603688:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882462.603689:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787882462.603691:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787882462.603692:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787882462.603694:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787882462.603695:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882462.603696:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787882462.603713:0:5824:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787882462.628377:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787882462.629497:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787882462.630966:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787882462.631180:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787882462.631394:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787882462.631571:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787882462.633427:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787882462.633769:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787882462.634338:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787882462.634538:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787882462.636107:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787882462.636301:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787882462.721386:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787882462.765415:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787882462.765643:0:5890:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1787882462.765648:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787882462.765788:0:5891:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787882462.775016:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787882462.775955:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787882462.777230:0:5824:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787882462.777253:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787882462.777520:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787882462.784635:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787882462.786280:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787882462.786348:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787882462.789304:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787882462.789564:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787882462.795701:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787882462.795864:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787882462.796047:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787882462.796220:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787882462.796387:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787882462.796542:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787882462.796676:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787882462.796837:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787882462.797025:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787882462.797197:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787882462.797329:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787882462.797481:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787882462.797638:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787882462.798432:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787882462.799401:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787882462.799597:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787882462.800157:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787882462.800305:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787882462.800444:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787882462.801220:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787882462.801373:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787882462.801543:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787882462.802112:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787882462.802257:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787882462.802397:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787882462.802575:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787882462.802718:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787882462.802907:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787882462.803748:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787882462.804157:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787882462.804312:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787882462.804463:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787882462.804765:0:5824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787882462.823739:0:5891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787882462.885906:0:5824:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787882462.885945:0:5824:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc0a681e0f988 00100000:10000000:1.0:1787882462.885953:0:5824:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787882462.889824:0:5824:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787882462.889844:0:5824:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787882462.889860:0:5824:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787882462.889937:0:5824:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1787882462.953230:0:5891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787882462.953318:0:5891:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787882462.953323:0:5891:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787882463.339907:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882464.362166:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882465.387146:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882466.410082:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882467.434068:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787882467.582838:0:6133:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787882467.627385:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787882467.627397:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787882467.627400:0:8:0:(import.c:65:import_set_state_nolock()) 000000000a9b02b9 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787882467.627415:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000a9b02b9 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1787882467.627441:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000aa160795 x1874730563931392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787882467.627490:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787882467.627492:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa160795 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874730563931392:0@lo:38: 00000100:00100000:2.0:1787882467.627525:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009979196 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563931264:0@lo:400: 00000100:00100000:3.0:1787882467.627592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882467.627900:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563931392 00000100:00100000:0.0:1787882467.627911:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563931392 00000100:00100000:0.0:1787882467.627951:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882467.627957:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008975e3e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874730563931392:12345-0@lo:38: 00010000:00080000:0.0:1787882467.627983:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:0.0:1787882467.628019:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf4731e8a7c5deb66 00000100:00100000:2.0:1787882467.631779:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:0.0:1787882467.631927:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1787882467.632027:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563931264 00000100:00100000:2.0:1787882467.632036:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563931264 00000100:00080000:0.0:1787882467.632066:0:5845:0:(import.c:65:import_set_state_nolock()) 000000006b0bfbb8 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787882467.632087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787882467.632214:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008975e3e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874730563931392:12345-0@lo:38: Request processed in 4255us (4622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882467.632224:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787882467.632275:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000aa160795 x1874730563931392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787882477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787882467.632292:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787882467.632299:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787882467.632316:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787882467.632318:0:3304:0:(import.c:65:import_set_state_nolock()) 000000000a9b02b9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787882467.632324:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa160795 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874730563931392:0@lo:38: 00000100:00100000:2.0:1787882467.632651:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9854ad0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:3308:x1874730563931264:12345-0@lo:400: 00000100:00100000:2.0:1787882467.632704:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9854ad0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:3308:x1874730563931264:12345-0@lo:400: Request processed in 609us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882467.632719:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787882467.633338:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009979196 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563931264:0@lo:400: 00010000:00010000:3.0:1787882468.463076:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787882469.162060:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787882469.162071:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa285a97800 from 3 10000000:01000000:0.0:1787882469.162077:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787882469.162137:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 000000000feb4143/0xf4731e8a7c5deb6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882469.162152:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 000000000feb4143/0xf4731e8a7c5deb6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882469.162163:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 000000000feb4143/0xf4731e8a7c5deb6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882469.162188:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000163cb4c1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563931520:0@lo:101: 00000100:00100000:0.0:1787882469.162265:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882469.162402:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000103851fe going to sleep for 11 seconds 00000100:00100000:2.0:1787882469.164994:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563931520 00000100:00100000:2.0:1787882469.165012:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563931520 00000100:00100000:2.0:1787882469.165086:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787882469.165097:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086610c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:5841:x1874730563931520:12345-0@lo:101: 00010000:00010000:2.0:1787882469.165117:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882469.165136:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000089ff105d/0xf4731e8a7c5deb74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5deb6d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882469.165170:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089ff105d/0xf4731e8a7c5deb74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb6d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882469.165182:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000089ff105d/0xf4731e8a7c5deb74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb6d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882469.165193:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000089ff105d, rc 0) 00000100:00100000:2.0:1787882469.165651:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086610c53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5841:x1874730563931520:12345-0@lo:101: Request processed in 555us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882469.165661:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787882469.165926:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000163cb4c1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563931520:0@lo:101: 00010000:00010000:0.0:1787882469.165948:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 000000000feb4143/0xf4731e8a7c5deb6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882469.165959:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 000000000feb4143/0xf4731e8a7c5deb6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882469.166054:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000163cb4c1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563931648:0@lo:256: 00000100:00100000:0.0:1787882469.166098:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882469.166146:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000103851fe going to sleep for 11 seconds 00000100:00100000:2.0:1787882469.166351:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563931648 00000100:00100000:2.0:1787882469.166357:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563931648 00000100:00100000:2.0:1787882469.166397:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787882469.166405:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044b51b24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5841:x1874730563931648:12345-0@lo:256: 20000000:01000000:2.0:1787882469.166421:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787882469.166438:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787882469.166442:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787882469.166542:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044b51b24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5841:x1874730563931648:12345-0@lo:256: Request processed in 139us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882469.166558:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787882469.166786:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000163cb4c1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563931648:0@lo:256: 10000000:01000000:0.0:1787882469.166831:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787882469.166839:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 000000000feb4143/0xf4731e8a7c5deb6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882469.166847:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 000000000feb4143/0xf4731e8a7c5deb6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882469.482493:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882470.509356:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882471.532658:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787882472.385317:0:6336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9add3650 20000000:00000080:1.0:1787882472.385342:0:6336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa2838c1800 uarg=0000000000000000 20000000:01000000:1.0:1787882472.385384:0:6336:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787882472.385391:0:6336:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787882472.385397:0:6336:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787882472.385735:0:6336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787882472.385750:0:6336:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787882472.390635:0:6336:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787882472.391577:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787882472.391654:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787882472.391715:0:6336:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787882472.391750:0:6336:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787882472.391770:0:6336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882472.391791:0:6336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000db50e4f1/0xf4731e8a7c5deb3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb35 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882472.391804:0:6336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882472.392167:0:6336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000db50e4f1/0xf4731e8a7c5deb3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5deb35 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882472.392183:0:6336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000db50e4f1/0xf4731e8a7c5deb3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb35 expref: 11 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882472.392198:0:6336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000163cb4c1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6336:1874730563931776:0@lo:104: 00000100:00100000:0.0:1787882472.392269:0:6336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882472.392350:0:6336:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2fdb7e2 going to sleep for 11 seconds 00000100:00100000:1.0:1787882472.392394:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563931776 00000100:00100000:1.0:1787882472.392403:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563931776 00000100:00100000:1.0:1787882472.392470:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787882472.392480:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae9e5740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:6336:x1874730563931776:12345-0@lo:104: 00010000:00010000:1.0:1787882472.392494:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882472.392577:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787882472.392582:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae9e5740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:6336:x1874730563931776:12345-0@lo:104: Request processed in 105us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882472.392589:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787882472.392651:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882472.392662:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.392669:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e3c94fb3 already unused, calling callback (00000000eb656bbb) 10000000:00010000:3.0:1787882472.392672:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.392679:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882472.392685:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882472.392690:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787882472.392742:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.392750:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882472.392771:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.392778:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: 00000000e3c94fb3/0xf4731e8a7c5deb35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.392812:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882472.392814:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882472.392816:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882472.392829:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058cd7a2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563931904:0@lo:103: 00000100:00100000:3.0:1787882472.392861:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882472.392936:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563931904 00000100:00100000:3.0:1787882472.392940:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563931904 00010000:00010000:3.0:1787882472.392965:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000db50e4f1/0xf4731e8a7c5deb3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb35 expref: 12 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882472.392989:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787882472.392995:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f4aeb8c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3308:x1874730563931904:12345-0@lo:103: 00010000:00010000:3.0:1787882472.393006:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882472.393011:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000db50e4f1/0xf4731e8a7c5deb3c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb35 expref: 12 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.393021:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000db50e4f1/0xf4731e8a7c5deb3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb35 expref: 12 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.393038:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.393046:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.393059:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.393065:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.393073:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.393078:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.393084:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000358c749a already unused, calling callback (0000000006379d3e) 00010000:00010000:3.0:1787882472.393089:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.393103:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.393111:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882472.393121:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882472.393150:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f4aeb8c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3308:x1874730563931904:12345-0@lo:103: Request processed in 155us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882472.393157:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787882472.393199:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058cd7a2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563931904:0@lo:103: 00010000:00010000:2.0:1787882472.393780:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000db50e4f1/0xf4731e8a7c5deb3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5deb35 expref: 11 pid: 5838 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882472.394021:0:6336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000163cb4c1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6336:1874730563931776:0@lo:104: 00010000:00010000:2.0:1787882472.394041:0:6336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882472.394050:0:6336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882472.394055:0:6336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882472.394060:0:6336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000358c749a/0xf4731e8a7c5deb7b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882472.555402:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882472.746379:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787882472.746411:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edc0a572 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563932032:0@lo:400: 00000100:00100000:2.0:1787882472.746496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882472.746698:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563932032 00000100:00100000:1.0:1787882472.746709:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563932032 00000100:00100000:1.0:1787882472.746782:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787882472.746793:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f02a06cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563932032:12345-0@lo:400: 00000100:00100000:1.0:1787882472.746858:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f02a06cb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563932032:12345-0@lo:400: Request processed in 67us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882472.746866:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787882472.746993:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000edc0a572 x1874730563932032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882472.747021:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edc0a572 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563932032:0@lo:400: 00010000:00010000:3.0:1787882473.580411:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882474.602194:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882475.627199:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882476.658941:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787882476.842061:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787882476.842069:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa285a97800 from 1 10000000:01000000:1.0:1787882476.842075:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787882476.842126:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000581ecb18/0xf4731e8a7c5deb82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882476.842141:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000581ecb18/0xf4731e8a7c5deb82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882476.842152:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000581ecb18/0xf4731e8a7c5deb82 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882476.842185:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a76395e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563932160:0@lo:101: 00000100:00100000:1.0:1787882476.842266:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882476.842340:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c88d6e31 going to sleep for 11 seconds 00000100:00100000:3.0:1787882476.842437:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563932160 00000100:00100000:3.0:1787882476.842447:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563932160 00000100:00100000:3.0:1787882476.842519:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787882476.842529:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000daec71fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:5841:x1874730563932160:12345-0@lo:101: 00010000:00010000:3.0:1787882476.842544:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882476.842559:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3c94fb3/0xf4731e8a7c5deb89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5deb82 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882476.842583:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3c94fb3/0xf4731e8a7c5deb89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb82 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882476.842608:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3c94fb3/0xf4731e8a7c5deb89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb82 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882476.842617:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3c94fb3, rc 0) 00000100:00100000:3.0:1787882476.842676:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000daec71fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5841:x1874730563932160:12345-0@lo:101: Request processed in 148us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882476.842683:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787882476.842724:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a76395e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563932160:0@lo:101: 00010000:00010000:1.0:1787882476.842742:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000581ecb18/0xf4731e8a7c5deb82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882476.842751:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000581ecb18/0xf4731e8a7c5deb82 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882476.842804:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a76395e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563932288:0@lo:501: 00000100:00100000:1.0:1787882476.842831:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882476.842859:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c88d6e31 going to sleep for 11 seconds 00000100:00100000:3.0:1787882476.842928:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563932288 00000100:00100000:3.0:1787882476.842933:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563932288 00000100:00100000:3.0:1787882476.842963:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787882476.842970:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019390b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5841:x1874730563932288:12345-0@lo:501: 00000100:00100000:3.0:1787882476.843236:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019390b2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5841:x1874730563932288:12345-0@lo:501: Request processed in 266us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882476.843244:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787882476.843465:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a76395e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563932288:0@lo:501: 00000100:00100000:0.0:1787882476.843568:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3525590 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563932416:0@lo:503: 00000100:00100000:0.0:1787882476.843612:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882476.843643:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b154fdd2 going to sleep for 11 seconds 00000100:00100000:3.0:1787882476.843696:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563932416 00000100:00100000:3.0:1787882476.843710:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563932416 00000100:00100000:3.0:1787882476.843741:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787882476.843747:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046f7452a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5841:x1874730563932416:12345-0@lo:503: 00000100:00100000:3.0:1787882476.844004:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046f7452a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5841:x1874730563932416:12345-0@lo:503: Request processed in 256us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882476.844012:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787882476.844097:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3525590 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563932416:0@lo:503: 00000100:00100000:2.0:1787882476.861468:0:6626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000d22fc12 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6626:1874730563932544:0@lo:502: 00000100:00100000:2.0:1787882476.861565:0:6626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882476.861631:0:6626:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5c8645f going to sleep for 11 seconds 00000100:00100000:0.0:1787882476.861933:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563932544 00000100:00100000:0.0:1787882476.861942:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563932544 00000100:00100000:0.0:1787882476.861995:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787882476.862005:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abd3c5bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6626:x1874730563932544:12345-0@lo:502: 00000100:00100000:0.0:1787882476.862308:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abd3c5bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6626:x1874730563932544:12345-0@lo:502: Request processed in 303us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882476.862317:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787882476.862605:0:6626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000d22fc12 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6626:1874730563932544:0@lo:502: 00000020:01000000:1.0:1787882476.862643:0:6626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882476.862654:0:6626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882476.862657:0:6626:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787882476.862672:0:6626:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa285a97800 00000020:00000080:1.0:1787882476.862674:0:6626:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787882476.862732:0:6626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6626:1874730563932672:0@lo:502: 00000100:00100000:1.0:1787882476.862780:0:6626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882476.862816:0:6626:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b72c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882476.862982:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563932672 00000100:00100000:0.0:1787882476.862989:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563932672 00000100:00100000:0.0:1787882476.863027:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787882476.863036:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6626:x1874730563932672:12345-0@lo:502: 00000100:00100000:0.0:1787882476.863201:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6626:x1874730563932672:12345-0@lo:502: Request processed in 165us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882476.863208:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787882476.868177:0:6626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6626:1874730563932672:0@lo:502: 00000020:01000000:2.0:1787882476.868237:0:6626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787882476.868248:0:6626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882476.868250:0:6626:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787882476.868256:0:6626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787882476.868824:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787882476.868849:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787882476.868862:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7000/0xf4731e8a7c5deb82 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882476.868899:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7000/0xf4731e8a7c5deb82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882477.675025:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882477.866229:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787882477.866258:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563932928:0@lo:400: 00000100:00100000:0.0:1787882477.866344:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882477.866425:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563932928 00000100:00100000:0.0:1787882477.866435:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563932928 00000100:00100000:0.0:1787882477.866502:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882477.866512:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563932928:12345-0@lo:400: 00000100:00100000:0.0:1787882477.866585:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563932928:12345-0@lo:400: Request processed in 74us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882477.866594:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787882477.866638:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa2af848a80 x1874730563932928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882477.866653:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563932928:0@lo:400: 00000100:00100000:1.0:1787882477.867087:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787882477.867099:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563932800:0@lo:400: 00000100:00100000:1.0:1787882477.867141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882477.867241:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563932800 00000100:00100000:2.0:1787882477.867247:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563932800 00000100:00100000:2.0:1787882477.867289:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787882477.867298:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3305:x1874730563932800:12345-0@lo:400: 00000100:00100000:2.0:1787882477.867348:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3305:x1874730563932800:12345-0@lo:400: Request processed in 52us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882477.867355:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787882477.867907:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563932800:0@lo:400: 00010000:00010000:3.0:1787882478.698896:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787882478.840178:0:6706:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787882478.840182:0:6706:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787882478.840306:0:6706:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa29d82f000 00000020:01000004:3.0:1787882478.840323:0:6706:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787882478.840335:0:6706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787882478.840356:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fa2866eb370) 00000020:00000080:3.0:1787882478.840385:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787882478.873750:0:6706:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787882478.874278:0:6706:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787882478.913297:0:6706:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787882478.926554:0:6706:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787882478.926709:0:6706:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787882478.926763:0:6706:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787882478.926789:0:6706:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787882478.927711:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787882478.927722:0:6706:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787882478.927732:0:6706:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf4731e8a7c5deb97 00000020:01000004:0.0:1787882478.927741:0:6706:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787882478.927762:0:6706:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787882478.927765:0:6706:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787882478.927771:0:6706:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787882478.927775:0:6706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787882478.927797:0:6706:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fa2b713b370) 00000020:00000080:0.0:1787882478.927809:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787882478.930110:0:6706:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882478.930294:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787882478.930300:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787882478.935298:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787882478.935312:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787882478.936841:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787882478.936851:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787882478.938414:0:6706:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787882478.940816:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787882478.940825:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787882478.943379:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787882478.943390:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787882478.972148:0:6706:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787882478.972418:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787882478.972426:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787882478.974202:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787882478.974226:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787882478.977049:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787882478.977071:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787882478.980242:0:6706:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787882478.980522:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787882478.980530:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787882478.981433:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787882478.981443:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787882479.032619:0:6706:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882479.032835:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787882479.032841:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787882479.034744:0:6706:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787882479.034758:0:6706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787882479.035741:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787882479.035769:0:6706:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787882479.035782:0:6706:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787882479.059061:0:6706:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787882479.059100:0:6706:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.121@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787882479.059108:0:6706:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787882479.059110:0:6706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787882479.059111:0:6706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787882479.059112:0:6706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787882479.059113:0:6706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787882479.059114:0:6706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787882479.059116:0:6706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787882479.059117:0:6706:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787882479.059118:0:6706:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787882479.059119:0:6706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787882479.059120:0:6706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787882479.059124:0:6706:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787882479.059126:0:6706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787882479.059127:0:6706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787882479.059128:0:6706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787882479.059129:0:6706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787882479.059130:0:6706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787882479.059131:0:6706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787882479.059132:0:6706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787882479.059133:0:6706:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787882479.059139:0:6706:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787882479.059140:0:6706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787882479.059141:0:6706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787882479.059168:0:6706:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787882479.059187:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563933056:0@lo:253: 00000100:00100000:1.0:1787882479.059262:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.059378:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa286054840 going to sleep for 11 seconds 00000100:00100000:0.0:1787882479.059470:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563933056 00000100:00100000:0.0:1787882479.059478:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563933056 00000100:00100000:0.0:1787882479.059621:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787882479.059632:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563933056:12345-0@lo:253: 20000000:01000000:0.0:1787882479.059663:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787882479.059667:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787882479.059672:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787882479.059676:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787882479.060516:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787882479.060750:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787882479.060764:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787882479.060801:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787882479.060809:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787882479.060838:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787882479.060916:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787882479.061285:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787882479.061307:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.121@tcp 20000000:01000000:0.0:1787882479.061309:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:0.0:1787882479.061343:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787882479.061351:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787882479.061412:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787882479.061421:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:0.0:1787882479.061455:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787882479.061465:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787882479.061496:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787882479.061570:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787882479.062284:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787882479.062304:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.121@tcp 20000000:01000000:0.0:1787882479.062305:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:0.0:1787882479.062338:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787882479.062353:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787882479.062788:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787882479.062799:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:3.0:1787882479.062981:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787882479.062994:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787882479.063031:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787882479.063068:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787882479.063087:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787882479.063090:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787882479.063094:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787882479.063107:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787882479.063110:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787882479.063147:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787882479.063150:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787882479.063718:0:6721:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787882479.063769:0:6721:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787882479.063818:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787882479.064253:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787882479.064295:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787882479.064329:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787882479.064341:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787882479.064343:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787882479.064844:0:6722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787882479.065235:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787882479.065274:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787882479.065366:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787882479.065382:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787882479.065384:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787882479.065854:0:6723:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787882479.066029:0:6723:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787882479.066087:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787882479.066352:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787882479.066390:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787882479.066446:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787882479.066462:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787882479.066474:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787882479.066486:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787882479.066508:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.066582:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2c21c7400/0xf4731e8a7c5deabe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deab7 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.066591:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2c21c7a00/0xf4731e8a7c5deada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dead3 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.066598:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5deb4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb43 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.066605:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.066647:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5deb4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5deb43 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.066663:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5deb4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb43 expref: 12 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882479.066678:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874730563933184:0@lo:104: 00000100:00100000:3.0:1787882479.066753:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787882479.066851:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2c21c7a00/0xf4731e8a7c5deada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dead3 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.066859:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2c21c7a00/0xf4731e8a7c5deada lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dead3 expref: 12 pid: 5838 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882479.066900:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874730563933312:0@lo:104: 00000100:00100000:3.0:1787882479.066930:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787882479.067102:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2c21c7400/0xf4731e8a7c5deabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5deab7 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.067110:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2c21c7400/0xf4731e8a7c5deabe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5deab7 expref: 12 pid: 5837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882479.067119:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874730563933440:0@lo:104: 00000100:00100000:3.0:1787882479.067139:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882479.067162:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563933184 00000100:00100000:0.0:1787882479.067169:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563933184 00000100:00100000:1.0:1787882479.067223:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563933312 00000100:00100000:1.0:1787882479.067226:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563933312 00000100:00100000:1.0:1787882479.067248:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787882479.067257:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:5835:x1874730563933184:12345-0@lo:104: 00010000:00010000:1.0:1787882479.067269:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe200/0xf4731e8a7c5deb43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067327:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787882479.067334:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:5835:x1874730563933184:12345-0@lo:104: Request processed in 78us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882479.067347:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787882479.067364:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787882479.067370:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5835:x1874730563933312:12345-0@lo:104: 00010000:00010000:1.0:1787882479.067378:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dead3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067416:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787882479.067421:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5835:x1874730563933312:12345-0@lo:104: Request processed in 51us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882479.067426:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787882479.067446:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787882479.067451:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe200/0xf4731e8a7c5deb43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067457:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813fe200 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882479.067461:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe200/0xf4731e8a7c5deb43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067469:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe200/0xf4731e8a7c5deb43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882479.067476:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe200/0xf4731e8a7c5deb43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882479.067481:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882479.067508:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe200/0xf4731e8a7c5deb43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067515:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882479.067557:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe200/0xf4731e8a7c5deb43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067564:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe200/0xf4731e8a7c5deb43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067580:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882479.067583:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dead3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067589:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031e00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882479.067592:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dead3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067598:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dead3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882479.067603:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dead3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882479.067608:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882479.067621:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dead3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067626:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882479.067640:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dead3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067645:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dead3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deada expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067655:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882479.067661:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882479.067663:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882479.067679:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787882479.067701:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563933568:0@lo:103: 00000100:00100000:1.0:1787882479.067733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.067762:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563933696:0@lo:103: 00000100:00100000:1.0:1787882479.067783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.067833:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563933568 00000100:00100000:1.0:1787882479.067839:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563933568 00010000:00010000:1.0:1787882479.067857:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5deb4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb43 expref: 13 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882479.067908:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563933696 00000100:00100000:1.0:1787882479.067912:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563933696 00010000:00010000:1.0:1787882479.067924:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2c21c7a00/0xf4731e8a7c5deada lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dead3 expref: 14 pid: 5838 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882479.067936:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787882479.067942:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:3307:x1874730563933568:12345-0@lo:103: 00010000:00010000:1.0:1787882479.067951:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882479.067956:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5deb4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb43 expref: 14 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067966:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5deb4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb43 expref: 14 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.067980:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882479.068009:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:3307:x1874730563933568:12345-0@lo:103: Request processed in 67us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882479.068015:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787882479.068035:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787882479.068041:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:3305:x1874730563933696:12345-0@lo:103: 00010000:00010000:1.0:1787882479.068049:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882479.068053:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2c21c7a00/0xf4731e8a7c5deada lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dead3 expref: 13 pid: 5838 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.068061:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2c21c7a00/0xf4731e8a7c5deada lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dead3 expref: 13 pid: 5838 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.068071:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882479.068098:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:3305:x1874730563933696:12345-0@lo:103: Request processed in 57us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882479.068104:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787882479.068142:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563933696:0@lo:103: 00000100:00100000:1.0:1787882479.068164:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563933568:0@lo:103: 00010000:00010000:2.0:1787882479.068300:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882479.068382:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298043180 going to sleep for 11 seconds 00010000:00010000:3.0:1787882479.068397:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5deb4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5deb43 expref: 12 pid: 5835 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882479.068407:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874730563933184:0@lo:104: 00010000:00010000:3.0:1787882479.068415:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2c21c7a00/0xf4731e8a7c5deada lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dead3 expref: 11 pid: 5838 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882479.068422:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874730563933312:0@lo:104: 00000100:00100000:0.0:1787882479.068483:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563933440 00000100:00100000:0.0:1787882479.068488:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563933440 00000100:00100000:0.0:1787882479.068509:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787882479.068516:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5835:x1874730563933440:12345-0@lo:104: 00010000:00010000:0.0:1787882479.068525:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa280031c00/0xf4731e8a7c5deab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882479.068647:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874730563933440:0@lo:104: 00010000:00010000:3.0:1787882479.068666:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.068936:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787882479.068944:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5835:x1874730563933440:12345-0@lo:104: Request processed in 428us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882479.068950:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787882479.069248:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882479.069255:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280031c00/0xf4731e8a7c5deab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069262:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031c00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1787882479.069266:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031c00/0xf4731e8a7c5deab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069276:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280031c00/0xf4731e8a7c5deab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882479.069283:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031c00/0xf4731e8a7c5deab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882479.069289:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787882479.069326:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280031c00/0xf4731e8a7c5deab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069344:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787882479.069370:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280031c00/0xf4731e8a7c5deab7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069377:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280031c00/0xf4731e8a7c5deab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deabe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069394:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882479.069395:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882479.069397:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882479.069404:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787882479.069415:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563933824:0@lo:103: 00000100:00100000:2.0:1787882479.069455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882479.069494:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563933824 00000100:00100000:2.0:1787882479.069500:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563933824 00010000:00010000:2.0:1787882479.069519:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2c21c7400/0xf4731e8a7c5deabe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deab7 expref: 11 pid: 5837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882479.069542:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787882479.069548:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:3305:x1874730563933824:12345-0@lo:103: 00010000:00010000:2.0:1787882479.069558:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882479.069563:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2c21c7400/0xf4731e8a7c5deabe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deab7 expref: 11 pid: 5837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069573:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2c21c7400/0xf4731e8a7c5deabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5deab7 expref: 11 pid: 5837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069584:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2c21c7400/0xf4731e8a7c5deabe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5deab7 expref: 11 pid: 5837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069609:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069618:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069632:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069639:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069647:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069653:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069659:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa281523400 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882479.069663:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069671:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069683:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.069703:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882479.069735:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+10:3305:x1874730563933824:12345-0@lo:103: Request processed in 187us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882479.069751:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787882479.069793:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563933824:0@lo:103: 00010000:00010000:3.0:1787882479.069850:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.069857:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.069862:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5deba5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787882479.069908:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787882479.114307:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:6706:x1874730563933056:12345-0@lo:253: Request processed in 54668us (55035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882479.114322:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787882479.114590:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563933056:0@lo:253: 10000000:01000000:1.0:1787882479.114608:0:6706:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787882479.114611:0:6706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787882479.114613:0:6706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787882479.114614:0:6706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787882479.114615:0:6706:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787882479.114617:0:6706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787882479.114618:0:6706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787882479.114619:0:6706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787882479.114621:0:6706:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787882479.114622:0:6706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787882479.114624:0:6706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787882479.114645:0:6706:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa29d82f000 from lustre-OST0000 10000000:01000000:1.0:1787882479.114671:0:6706:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787882479.114674:0:6706:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787882479.114682:0:6706:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa297fcb370 local copy 10000000:01000000:1.0:1787882479.114710:0:6706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787882479.114746:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.114757:0:6706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.114766:0:6706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882479.114784:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563933952:0@lo:101: 00000100:00100000:1.0:1787882479.114824:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882479.114954:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563933952 00000100:00100000:0.0:1787882479.114961:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563933952 00000100:00100000:0.0:1787882479.115037:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787882479.115048:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:6706:x1874730563933952:12345-0@lo:101: 00010000:00010000:0.0:1787882479.115062:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882479.115082:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280031e00/0xf4731e8a7c5debb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5debac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.115108:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280031e00/0xf4731e8a7c5debb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5debac expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.115120:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280031e00/0xf4731e8a7c5debb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5debac expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.115129:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031e00, rc 0) 00000100:00100000:0.0:1787882479.115159:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+10:6706:x1874730563933952:12345-0@lo:101: Request processed in 114us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882479.115165:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787882479.115223:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa284e619c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882479.115238:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563933952:0@lo:101: 00010000:00010000:1.0:1787882479.115251:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.115259:0:6706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882479.115371:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934080:0@lo:501: 00000100:00100000:1.0:1787882479.115398:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.115648:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa284e619c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882479.115694:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563934080 00000100:00100000:2.0:1787882479.115701:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563934080 00000100:00100000:0.0:1787882479.115740:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787882479.115749:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+10:6706:x1874730563934080:12345-0@lo:501: 00000100:00100000:0.0:1787882479.115974:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+10:6706:x1874730563934080:12345-0@lo:501: Request processed in 226us (574us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787882479.115981:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787882479.116093:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934080:0@lo:501: 10000000:01000000:1.0:1787882479.116107:0:6706:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787882479.116136:0:6706:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787882479.116142:0:6706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.116160:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.116167:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.116192:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787882479.116215:0:6706:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa29d82f000 10000000:01000000:1.0:1787882479.116221:0:6706:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787882479.116225:0:6706:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fa297fcb370 10000000:01000000:1.0:1787882479.116228:0:6706:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787882479.116231:0:6706:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fa297fcb370 from 1 10000000:01000000:1.0:1787882479.116234:0:6706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787882479.116254:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7a00/0xf4731e8a7c5debba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.116261:0:6706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7a00/0xf4731e8a7c5debba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.116268:0:6706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7a00/0xf4731e8a7c5debba lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882479.116282:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934208:0@lo:101: 00000100:00100000:1.0:1787882479.116309:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.116326:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa284e61240 going to sleep for 11 seconds 00010000:00010000:3.0:1787882479.116377:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882479.116384:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.116393:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2c21c6000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882479.116396:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.116404:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882479.116410:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882479.116415:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787882479.116435:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.116441:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882479.116474:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.116481:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5debac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4731e8a7c5debb3 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.116497:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882479.116498:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882479.116500:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882479.116510:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563934208 00000100:00100000:3.0:1787882479.116521:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563934208 00000100:00100000:3.0:1787882479.116544:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787882479.116551:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+10:6706:x1874730563934208:12345-0@lo:101: 00010000:00010000:3.0:1787882479.116560:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882479.116572:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5debc1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5debba expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.116590:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5debc1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5debba expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.116599:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5debc1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5debba expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.116607:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa281523400, rc 0) 00000100:00100000:3.0:1787882479.116639:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:6706:x1874730563934208:12345-0@lo:101: Request processed in 88us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882479.116645:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787882479.116770:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563934336:0@lo:103: 00000100:00100000:1.0:1787882479.116801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.116853:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934208:0@lo:101: 00010000:00010000:1.0:1787882479.116897:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7a00/0xf4731e8a7c5debba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debc1 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.116905:0:6706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7a00/0xf4731e8a7c5debba lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5debc1 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882479.116922:0:6706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787882479.116932:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7a00/0xf4731e8a7c5debba lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debc1 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.116940:0:6706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7a00/0xf4731e8a7c5debba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debc1 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882479.116946:0:6706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787882479.116961:0:6706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787882479.116967:0:6706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787882479.116969:0:6706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787882479.116983:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.116990:0:6706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.116998:0:6706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882479.117009:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934464:0@lo:101: 00000100:00100000:1.0:1787882479.117033:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.117044:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa284e61240 going to sleep for 11 seconds 00000100:00100000:3.0:1787882479.117119:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563934336 00000100:00100000:3.0:1787882479.117124:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563934336 00000100:00100000:3.0:1787882479.117156:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787882479.117162:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:3307:x1874730563934336:12345-0@lo:103: 00010000:00010000:3.0:1787882479.117171:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882479.117185:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031e00/0xf4731e8a7c5debb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5debac expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.117198:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882479.117224:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+10:3307:x1874730563934336:12345-0@lo:103: Request processed in 62us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882479.117230:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787882479.117259:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563934464 00000100:00100000:3.0:1787882479.117263:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563934464 00000100:00100000:3.0:1787882479.117277:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787882479.117282:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+10:6706:x1874730563934464:12345-0@lo:101: 00010000:00010000:3.0:1787882479.117290:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882479.117299:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa281523000/0xf4731e8a7c5debcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5debc8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.117313:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa281523000/0xf4731e8a7c5debcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5debc8 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.117320:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa281523000/0xf4731e8a7c5debcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5debc8 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.117327:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa281523000, rc 0) 00000100:00100000:3.0:1787882479.117353:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:6706:x1874730563934464:12345-0@lo:101: Request processed in 70us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882479.117358:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787882479.117433:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563934336:0@lo:103: 00000100:00100000:1.0:1787882479.117478:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934464:0@lo:101: 00010000:00010000:1.0:1787882479.117488:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.117496:0:6706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882479.117581:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934592:0@lo:501: 00000100:00100000:1.0:1787882479.117606:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.117631:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa284e61240 going to sleep for 11 seconds 00000100:00100000:3.0:1787882479.117746:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563934592 00000100:00100000:3.0:1787882479.117750:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563934592 00000100:00100000:3.0:1787882479.117768:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787882479.117773:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:6706:x1874730563934592:12345-0@lo:501: 00000100:00100000:3.0:1787882479.118021:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:6706:x1874730563934592:12345-0@lo:501: Request processed in 245us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882479.118028:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787882479.118099:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934592:0@lo:501: 00000100:00100000:1.0:1787882479.118127:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934720:0@lo:503: 00000100:00100000:1.0:1787882479.118164:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.118220:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa284e61240 going to sleep for 11 seconds 00000100:00100000:2.0:1787882479.118288:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563934720 00000100:00100000:2.0:1787882479.118292:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563934720 00000100:00100000:2.0:1787882479.118311:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787882479.118317:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:6706:x1874730563934720:12345-0@lo:503: 00000100:00100000:1.0:1787882479.118553:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934720:0@lo:503: 00000040:00080000:1.0:1787882479.118835:0:6706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787882479.118940:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934848:0@lo:502: 00000100:00100000:1.0:1787882479.118979:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.118990:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa284e61240 going to sleep for 11 seconds 00000100:00100000:2.0:1787882479.119243:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:6706:x1874730563934720:12345-0@lo:503: Request processed in 142us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882479.119252:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787882479.119295:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563934848 00000100:00100000:2.0:1787882479.119301:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563934848 00000100:00100000:2.0:1787882479.119321:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787882479.119327:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:6706:x1874730563934848:12345-0@lo:502: 00000100:00100000:2.0:1787882479.119650:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:6706:x1874730563934848:12345-0@lo:502: Request processed in 322us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882479.119657:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787882479.119884:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934848:0@lo:502: 00000040:00080000:1.0:1787882479.120166:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787882479.120219:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787882479.120249:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787882479.120292:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787882479.120325:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787882479.120353:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787882479.120392:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934976:0@lo:502: 00000100:00100000:1.0:1787882479.120440:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.120550:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa284e61240 going to sleep for 11 seconds 00000100:00100000:2.0:1787882479.120612:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563934976 00000100:00100000:2.0:1787882479.120618:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563934976 00000100:00100000:2.0:1787882479.120655:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787882479.120664:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:6706:x1874730563934976:12345-0@lo:502: 00000100:00100000:2.0:1787882479.120836:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:6706:x1874730563934976:12345-0@lo:502: Request processed in 172us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882479.120843:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787882479.121030:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563934976:0@lo:502: 00000040:00080000:1.0:1787882479.121119:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787882479.121130:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787882479.121780:0:6725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787882479.121789:0:6725:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787882479.121796:0:6725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882479.121798:0:6725:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787882479.121804:0:6725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787882479.121820:0:6725:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fa2a99f8000) 00000020:00000080:1.0:1787882479.121841:0:6725:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787882479.121846:0:6725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787882479.122026:0:6725:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa29d82f000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787882479.122034:0:6725:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787882479.122049:0:6725:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf4731e8a7c5debdd 00010000:00010000:1.0:1787882479.132602:0:6725:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787882479.133055:0:6725:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787882479.135601:0:6725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787882479.135977:0:6725:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787882479.145178:0:6725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787882479.146073:0:6725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787882479.147413:0:6725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787882479.147426:0:6725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787882479.147433:0:6725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882479.147435:0:6725:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787882479.147439:0:6725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787882479.147442:0:6725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882479.147444:0:6725:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787882479.147447:0:6725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787882479.147449:0:6725:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787882479.147577:0:6725:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787882479.147582:0:6725:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882479.147583:0:6725:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787882479.147586:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787882479.147751:0:6706:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787882479.147774:0:6706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787882479.147797:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.147811:0:6706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882479.147819:0:6706:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa29d82f000 from 1 10000000:01000000:0.0:1787882479.147822:0:6706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787882479.147863:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.147919:0:6706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.147932:0:6706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882479.147956:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935104:0@lo:101: 00000100:00100000:0.0:1787882479.148027:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882479.148076:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287a269c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882479.148227:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563935104 00000100:00100000:2.0:1787882479.148235:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563935104 00000100:00100000:2.0:1787882479.148283:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787882479.148293:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:6706:x1874730563935104:12345-0@lo:101: 00010000:00010000:2.0:1787882479.148308:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882479.148323:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5debeb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5debe4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.148351:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5debeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5debe4 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.148362:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5debeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5debe4 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.148371:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813fe200, rc 0) 00000100:00100000:2.0:1787882479.148421:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563935104:12345-0@lo:101: Request processed in 129us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882479.148440:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787882479.148576:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935104:0@lo:101: 00010000:00010000:1.0:1787882479.148592:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.148601:0:6706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882479.148712:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935232:0@lo:501: 00000100:00100000:1.0:1787882479.148752:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.148778:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28809bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787882479.148828:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563935232 00000100:00100000:2.0:1787882479.148833:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563935232 00000100:00100000:2.0:1787882479.148849:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787882479.148855:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563935232:12345-0@lo:501: 00000100:00100000:2.0:1787882479.149097:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563935232:12345-0@lo:501: Request processed in 240us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882479.149104:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787882479.149180:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935232:0@lo:501: 00000100:00100000:1.0:1787882479.149206:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935360:0@lo:503: 00000100:00100000:1.0:1787882479.149240:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.149264:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28809bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787882479.149308:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563935360 00000100:00100000:2.0:1787882479.149312:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563935360 00000100:00100000:2.0:1787882479.149329:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787882479.149335:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563935360:12345-0@lo:503: 00000100:00100000:2.0:1787882479.149659:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563935360:12345-0@lo:503: Request processed in 322us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882479.149666:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787882479.155617:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935360:0@lo:503: 00000040:00080000:0.0:1787882479.156165:0:6706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787882479.156266:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935488:0@lo:502: 00000100:00100000:0.0:1787882479.156348:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882479.156394:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287a26540 going to sleep for 11 seconds 00000100:00100000:3.0:1787882479.156578:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563935488 00000100:00100000:3.0:1787882479.156585:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563935488 00000100:00100000:3.0:1787882479.156626:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787882479.156635:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563935488:12345-0@lo:502: 00000100:00100000:3.0:1787882479.156894:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563935488:12345-0@lo:502: Request processed in 259us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882479.156901:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787882479.157002:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935488:0@lo:502: 00000040:00080000:1.0:1787882479.157279:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787882479.157329:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787882479.157356:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935616:0@lo:502: 00000100:00100000:1.0:1787882479.157397:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.157431:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28809bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787882479.157726:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563935616 00000100:00100000:3.0:1787882479.157731:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563935616 00000100:00100000:3.0:1787882479.157767:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787882479.157775:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563935616:12345-0@lo:502: 00000100:00100000:3.0:1787882479.157952:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563935616:12345-0@lo:502: Request processed in 176us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882479.157959:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787882479.158041:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935616:0@lo:502: 00000040:00080000:1.0:1787882479.158128:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787882479.158139:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787882479.159003:0:6729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787882479.159015:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882479.159018:0:6729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787882479.159025:0:6729:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa29d82f000 00000020:00000080:0.0:1787882479.159028:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787882479.159047:0:6729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787882479.159049:0:6729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882479.159051:0:6729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787882479.159054:0:6729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787882479.162747:0:6706:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787882479.162788:0:6706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787882479.163990:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.164006:0:6706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882479.164138:0:6706:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787882479.164142:0:6706:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa29d82f000 10000000:01000000:2.0:1787882479.164145:0:6706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa29d82f000 10000000:01000000:2.0:1787882479.164149:0:6706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787882479.164155:0:6706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa29d82f000 from 1 10000000:01000000:2.0:1787882479.164157:0:6706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787882479.164195:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.164203:0:6706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.164215:0:6706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882479.164250:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935744:0@lo:101: 00000100:00100000:2.0:1787882479.164325:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882479.164374:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298a179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882479.164422:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563935744 00000100:00100000:3.0:1787882479.164430:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563935744 00000100:00100000:3.0:1787882479.164540:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787882479.164550:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563935744:12345-0@lo:101: 00010000:00010000:3.0:1787882479.164564:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882479.164579:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa281522e00/0xf4731e8a7c5debf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5debf2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.164602:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa281522e00/0xf4731e8a7c5debf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5debf2 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.164625:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa281522e00/0xf4731e8a7c5debf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5debf2 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882479.164634:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa281522e00, rc 0) 00000100:00100000:3.0:1787882479.164697:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:6706:x1874730563935744:12345-0@lo:101: Request processed in 137us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882479.164704:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787882479.164839:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935744:0@lo:101: 00010000:00010000:2.0:1787882479.164853:0:6706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.164862:0:6706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882479.165007:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935872:0@lo:501: 00000100:00100000:2.0:1787882479.165035:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882479.165052:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298a179c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882479.165104:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563935872 00000100:00100000:0.0:1787882479.165110:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563935872 00000100:00100000:0.0:1787882479.165137:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787882479.165145:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:6706:x1874730563935872:12345-0@lo:501: 00000100:00100000:0.0:1787882479.165376:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:6706:x1874730563935872:12345-0@lo:501: Request processed in 231us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882479.165392:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787882479.165529:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563935872:0@lo:501: 00000100:00100000:2.0:1787882479.165560:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563936000:0@lo:503: 00000100:00100000:2.0:1787882479.165599:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882479.165621:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298a179c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882479.165663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563936000 00000100:00100000:0.0:1787882479.165668:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563936000 00000100:00100000:0.0:1787882479.165722:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787882479.165787:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:6706:x1874730563936000:12345-0@lo:503: 00000100:00100000:0.0:1787882479.165961:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:6706:x1874730563936000:12345-0@lo:503: Request processed in 231us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882479.165967:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787882479.166130:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563936000:0@lo:503: 00000040:00080000:2.0:1787882479.166400:0:6706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787882479.166533:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563936128:0@lo:502: 00000100:00100000:2.0:1787882479.166574:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882479.166595:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298a179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882479.166664:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563936128 00000100:00100000:3.0:1787882479.166669:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563936128 00000100:00100000:3.0:1787882479.166718:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787882479.166726:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:6706:x1874730563936128:12345-0@lo:502: 00000100:00100000:3.0:1787882479.166909:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:6706:x1874730563936128:12345-0@lo:502: Request processed in 184us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882479.166916:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787882479.166947:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563936128:0@lo:502: 00000040:00080000:0.0:1787882479.167367:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787882479.167429:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787882479.167463:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787882479.167510:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787882479.167546:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787882479.167602:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787882479.167632:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787882479.167657:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787882479.167704:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787882479.167734:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787882479.167758:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787882479.167792:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787882479.167817:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787882479.167840:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787882479.167933:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787882479.167966:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787882479.168017:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787882479.168078:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787882479.168122:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787882479.168154:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787882479.168213:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787882479.168241:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787882479.168338:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787882479.168386:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787882479.168415:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787882479.168444:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787882479.168494:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787882479.168530:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787882479.168575:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563936256:0@lo:502: 00000100:00100000:0.0:1787882479.168646:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882479.168841:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287a269c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882479.169615:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563936256 00000100:00100000:1.0:1787882479.169626:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563936256 00000100:00100000:0.0:1787882479.169854:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787882479.169864:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:6706:x1874730563936256:12345-0@lo:502: 00000100:00100000:0.0:1787882479.170317:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:6706:x1874730563936256:12345-0@lo:502: Request processed in 453us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882479.170325:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787882479.170396:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563936256:0@lo:502: 00000040:00080000:1.0:1787882479.170515:0:6706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787882479.170539:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787882479.171224:0:6730:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787882479.171240:0:6730:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fa2b713cd28) 00000020:00000080:0.0:1787882479.171328:0:6730:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787882479.171419:0:6730:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa29d82f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787882479.171423:0:6730:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa29d82f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787882479.171426:0:6730:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa29d82f000 3 00010000:00080000:0.0:1787882479.171456:0:6730:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa2bb1cb800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1787882479.174493:0:6730:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787882479.174843:0:6730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787882479.175179:0:6730:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787882479.175199:0:6730:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf4731e8a7c5dec07 00000100:00080000:0.0:1787882479.175210:0:6730:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787882479.175216:0:6730:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fa2bb1cb800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1787882479.175337:0:6730:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2af848e00 x1874730563936384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787882479.175364:0:6730:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787882479.175525:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874730563936384:0@lo:38: 00000100:00100000:3.0:1787882479.175601:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882479.178167:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563936384 00000100:00100000:0.0:1787882479.178180:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563936384 00000100:00100000:0.0:1787882479.178230:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787882479.178241:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874730563936384:12345-0@lo:38: 00010000:00080000:0.0:1787882479.178272:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1787882479.178333:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf4731e8a7c5dec0e 00000004:00100000:0.0:1787882479.178353:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787882479.178394:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9fa2bb1c8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787882479.178494:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874730563936384:12345-0@lo:38: Request processed in 254us (2892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882479.178502:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787882479.178533:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563936512:0@lo:400: 00010000:00080000:2.0:1787882479.178554:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa2af848e00 x1874730563936384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787882489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882479.178570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882479.178577:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787882479.178585:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787882479.178593:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787882479.178597:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787882479.178600:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2bb1cb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787882479.178605:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874730563936384:0@lo:38: 00000100:00100000:0.0:1787882479.178605:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563936512 00000100:00100000:0.0:1787882479.178609:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563936512 00000100:00100000:0.0:1787882479.178631:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787882479.178636:0:5843:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787882479.178637:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563936512:12345-0@lo:400: 00000100:00100000:2.0:1787882479.178644:0:5843:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787882479.178682:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563936512:12345-0@lo:400: Request processed in 44us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882479.178699:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787882479.178706:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa29d8a1f80 x1874730563936512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882479.178715:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563936512:0@lo:400: 00000040:00080000:0.0:1787882479.178972:0:6730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787882479.180311:0:6706:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787882479.180555:0:6706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787882479.180611:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882479.180635:0:6706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787882479.180682:0:6706:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787882479.180684:0:6706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787882479.180697:0:6706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787882479.180699:0:6706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787882479.180700:0:6706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787882479.180702:0:6706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787882479.180703:0:6706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787882479.180705:0:6706:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787882479.180706:0:6706:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787882479.180708:0:6706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787882479.180709:0:6706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787882479.180713:0:6706:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787882479.180715:0:6706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787882479.180716:0:6706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787882479.180718:0:6706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787882479.180718:0:6706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787882479.180719:0:6706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787882479.180720:0:6706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787882479.180721:0:6706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787882479.180722:0:6706:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787882479.180723:0:6706:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787882479.180723:0:6706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787882479.180724:0:6706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787882479.180747:0:6706:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787882479.180764:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563936640:0@lo:253: 00000100:00100000:1.0:1787882479.180828:0:6706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882479.180897:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28809bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787882479.180960:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563936640 00000100:00100000:2.0:1787882479.180967:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563936640 00000100:00100000:2.0:1787882479.181014:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787882479.181025:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:6706:x1874730563936640:12345-0@lo:253: 20000000:01000000:2.0:1787882479.181067:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787882479.181082:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787882479.210433:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787882479.210455:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787882479.210569:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787882479.210575:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787882479.210597:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.210634:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5deb74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb6d expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.210644:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.210698:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5deb74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5deb6d expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.210713:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5deb74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb6d expref: 13 pid: 5837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882479.210729:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874730563936768:0@lo:104: 00000100:00100000:0.0:1787882479.210797:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882479.210858:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287dd1540 going to sleep for 11 seconds 00000100:00100000:2.0:1787882479.211371:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563936768 00000100:00100000:2.0:1787882479.211380:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563936768 00000100:00100000:2.0:1787882479.211432:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787882479.211441:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5860:x1874730563936768:12345-0@lo:104: 00010000:00010000:2.0:1787882479.211466:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa280030e00/0xf4731e8a7c5deb6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211544:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787882479.211551:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5860:x1874730563936768:12345-0@lo:104: Request processed in 111us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882479.211558:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787882479.211585:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882479.211591:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280030e00/0xf4731e8a7c5deb6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211597:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280030e00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1787882479.211601:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030e00/0xf4731e8a7c5deb6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211610:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280030e00/0xf4731e8a7c5deb6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882479.211617:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030e00/0xf4731e8a7c5deb6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882479.211623:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787882479.211650:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280030e00/0xf4731e8a7c5deb6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211657:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787882479.211675:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280030e00/0xf4731e8a7c5deb6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211682:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280030e00/0xf4731e8a7c5deb6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb74 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211720:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882479.211722:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882479.211723:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882479.211739:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563936896:0@lo:103: 00000100:00100000:2.0:1787882479.211775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882479.211817:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563936896 00000100:00100000:2.0:1787882479.211822:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563936896 00010000:00010000:2.0:1787882479.211838:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5deb74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb6d expref: 14 pid: 5837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882479.211859:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787882479.211864:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286600c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:3305:x1874730563936896:12345-0@lo:103: 00010000:00010000:2.0:1787882479.211897:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882479.211904:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5deb74 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb6d expref: 14 pid: 5837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211915:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5deb74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb6d expref: 14 pid: 5837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211934:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211942:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787882479.211958:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001383913s 00010000:00010000:2.0:1787882479.211963:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211980:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211987:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.211994:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.212000:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882479.212005:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.212012:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.212022:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882479.212031:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882479.212060:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286600c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:3305:x1874730563936896:12345-0@lo:103: Request processed in 196us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882479.212068:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787882479.212127:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563936896:0@lo:103: 00010000:00010000:0.0:1787882479.212440:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5deb74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5deb6d expref: 13 pid: 5837 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882479.212452:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874730563936768:0@lo:104: 00010000:00010000:0.0:1787882479.212464:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.212472:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.212478:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882479.212483:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dec15 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882479.218283:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:6706:x1874730563936640:12345-0@lo:253: Request processed in 37250us (37445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882479.218298:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787882479.218416:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:6706:1874730563936640:0@lo:253: 10000000:01000000:1.0:1787882479.218434:0:6706:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787882479.218438:0:6706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787882479.218439:0:6706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787882479.218467:0:6706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787882479.218469:0:6706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787882479.218470:0:6706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787882479.218472:0:6706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787882479.218473:0:6706:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787882479.218475:0:6706:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787882479.218476:0:6706:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787882479.218478:0:6706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787882479.218479:0:6706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787882479.218494:0:6706:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787882479.226409:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787882479.226699:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787882479.226928:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787882479.227108:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787882479.227316:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787882479.228167:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787882479.229323:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787882479.442063:0:6706:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787882479.442070:0:6706:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787882479.442103:0:6706:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787882479.442163:0:6706:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787882479.442179:0:6706:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787882479.442211:0:6706:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787882479.722219:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882480.745973:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882481.770746:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882482.795046:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882483.820354:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882484.524792:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787882484.524820:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563937024:0@lo:400: 00000100:00100000:1.0:1787882484.524928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882484.524997:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563937152:0@lo:400: 00000100:00100000:1.0:1787882484.525034:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882484.525057:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787882484.525062:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563937280:0@lo:400: 00000100:00100000:1.0:1787882484.525088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882484.527229:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563937024 00000100:00100000:0.0:1787882484.527244:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563937024 00000100:00100000:0.0:1787882484.527383:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787882484.527394:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3305:x1874730563937024:12345-0@lo:400: 00000100:00100000:0.0:1787882484.527596:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3305:x1874730563937024:12345-0@lo:400: Request processed in 203us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882484.527604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787882484.534126:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563937152 00000100:00100000:1.0:1787882484.534145:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563937152 00000100:00100000:1.0:1787882484.534216:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563937280 00000100:00100000:1.0:1787882484.534220:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563937280 00000100:00100000:1.0:1787882484.534263:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787882484.534273:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563937152:12345-0@lo:400: 00000100:00100000:1.0:1787882484.534388:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563937152:12345-0@lo:400: Request processed in 115us (9352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882484.534396:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787882484.534414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787882484.534675:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563937280:12345-0@lo:400: 00000100:00100000:1.0:1787882484.534714:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563937280:12345-0@lo:400: Request processed in 293us (9625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882484.534721:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787882484.534750:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787882484.534782:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af84f100 x1874730563937280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882484.534797:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563937280:0@lo:400: 00010000:00080000:1.0:1787882484.534809:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af84ea00 x1874730563937152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882484.534818:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563937152:0@lo:400: 00000100:00100000:1.0:1787882484.534867:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563937024:0@lo:400: 00010000:00010000:3.0:1787882484.842053:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882485.866003:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787882485.958400:0:7076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1787882486.571360:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787882486.571370:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa285a97800 from 21 10000000:01000000:0.0:1787882486.571377:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787882486.571448:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882486.571462:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882486.571476:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882486.571503:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563937408:0@lo:101: 00000100:00100000:0.0:1787882486.571595:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882486.571667:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b71713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882486.571671:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563937408 00000100:00100000:2.0:1787882486.571682:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563937408 00000100:00100000:2.0:1787882486.571750:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787882486.571768:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5841:x1874730563937408:12345-0@lo:101: 00010000:00010000:2.0:1787882486.571785:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882486.571798:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813ffc00/0xf4731e8a7c5dec23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dec1c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882486.571828:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813ffc00/0xf4731e8a7c5dec23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec1c expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882486.571841:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813ffc00/0xf4731e8a7c5dec23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec1c expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882486.571854:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813ffc00, rc 0) 00000100:00100000:2.0:1787882486.571928:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563937408:12345-0@lo:101: Request processed in 162us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882486.571935:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787882486.573120:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563937408:0@lo:101: 00010000:00010000:0.0:1787882486.573145:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882486.573157:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882486.573237:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563937536:0@lo:501: 00000100:00100000:0.0:1787882486.573286:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882486.573329:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b71713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882486.573660:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563937536 00000100:00100000:2.0:1787882486.573668:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563937536 00000100:00100000:2.0:1787882486.573719:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787882486.573728:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563937536:12345-0@lo:501: 00000100:00100000:2.0:1787882486.574171:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563937536:12345-0@lo:501: Request processed in 443us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882486.574180:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787882486.574225:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563937536:0@lo:501: 00000100:00100000:0.0:1787882486.574266:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563937664:0@lo:503: 00000100:00100000:0.0:1787882486.574310:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882486.574341:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b71713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882486.574358:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563937664 00000100:00100000:3.0:1787882486.574363:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563937664 00000100:00100000:3.0:1787882486.574395:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787882486.574404:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563937664:12345-0@lo:503: 00000100:00100000:3.0:1787882486.575390:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563937664:12345-0@lo:503: Request processed in 980us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882486.575409:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787882486.575509:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563937664:0@lo:503: 00000100:00100000:3.0:1787882486.576307:0:7102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7102:1874730563937792:0@lo:502: 00000100:00100000:3.0:1787882486.576368:0:7102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882486.576412:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563937792 00000100:00100000:2.0:1787882486.576420:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563937792 00000100:00100000:2.0:1787882486.576469:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787882486.576480:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7102:x1874730563937792:12345-0@lo:502: 00000100:00100000:3.0:1787882486.576769:0:7102:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749840 going to sleep for 11 seconds 00000100:00100000:2.0:1787882486.576783:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7102:x1874730563937792:12345-0@lo:502: Request processed in 305us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882486.576787:0:7102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7102:1874730563937792:0@lo:502: 00000100:00100000:2.0:1787882486.576798:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787882486.576834:0:7102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7102:1874730563937920:0@lo:502: 00000100:00100000:3.0:1787882486.576885:0:7102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882486.576902:0:7102:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749840 going to sleep for 11 seconds 00000100:00100000:2.0:1787882486.578431:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563937920 00000100:00100000:2.0:1787882486.578447:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563937920 00000100:00100000:2.0:1787882486.578503:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787882486.578515:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7102:x1874730563937920:12345-0@lo:502: 00000100:00100000:2.0:1787882486.578809:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7102:x1874730563937920:12345-0@lo:502: Request processed in 297us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882486.578817:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787882486.578924:0:7102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7102:1874730563937920:0@lo:502: 00000040:00080000:3.0:1787882486.578962:0:7102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787882486.579682:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787882486.579717:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787882486.579730:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882486.579744:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882486.579755:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787882486.579758:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa285a97800 from 4 10000000:01000000:0.0:1787882486.579773:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787882486.579815:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882486.579824:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882486.579834:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882486.579855:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563938048:0@lo:101: 00000100:00100000:0.0:1787882486.579942:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882486.580181:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563938048 00000100:00100000:2.0:1787882486.580190:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563938048 00000100:00100000:2.0:1787882486.580236:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787882486.580246:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563938048:12345-0@lo:101: 00010000:00010000:2.0:1787882486.580260:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882486.580277:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5dec31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dec2a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882486.580306:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5dec31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec2a expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882486.580317:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5dec31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec2a expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882486.580326:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813fea00, rc 0) 00000100:00100000:2.0:1787882486.580362:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563938048:12345-0@lo:101: Request processed in 119us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882486.580368:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787882486.580746:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b71713c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882486.580772:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563938048:0@lo:101: 00010000:00010000:0.0:1787882486.580789:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882486.580799:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882486.580860:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563938176:0@lo:256: 00000100:00100000:0.0:1787882486.580922:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882486.580948:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b71713c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882486.580997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563938176 00000100:00100000:2.0:1787882486.581003:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563938176 00000100:00100000:2.0:1787882486.581043:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787882486.581050:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563938176:12345-0@lo:256: 20000000:01000000:2.0:1787882486.581065:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787882486.581083:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787882486.581087:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787882486.581177:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563938176:12345-0@lo:256: Request processed in 127us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882486.581177:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563938176:0@lo:256: 00000100:00100000:2.0:1787882486.581184:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 10000000:01000000:0.0:1787882486.581221:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787882486.581228:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882486.581236:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882486.581250:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787882486.581252:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787882486.581254:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787882486.581273:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882486.581280:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882486.581288:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882486.581300:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563938304:0@lo:101: 00000100:00100000:0.0:1787882486.581325:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882486.581355:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b71713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882486.581484:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563938304 00000100:00100000:1.0:1787882486.581489:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563938304 00000100:00100000:1.0:1787882486.581523:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787882486.581531:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563938304:12345-0@lo:101: 00010000:00010000:1.0:1787882486.581540:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882486.581554:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dec3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dec38 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882486.581588:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dec3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec38 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882486.581598:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dec3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec38 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882486.581606:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2c21c6400, rc 0) 00000100:00100000:1.0:1787882486.581660:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563938304:12345-0@lo:101: Request processed in 130us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882486.581666:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787882486.581678:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563938304:0@lo:101: 00010000:00010000:2.0:1787882486.581690:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882486.581699:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882486.581750:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563938432:0@lo:501: 00000100:00100000:2.0:1787882486.581777:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882486.581802:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882486.581862:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563938432 00000100:00100000:0.0:1787882486.581909:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563938432 00000100:00100000:0.0:1787882486.581936:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787882486.581943:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563938432:12345-0@lo:501: 00000100:00100000:0.0:1787882486.582255:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563938432:12345-0@lo:501: Request processed in 311us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882486.582262:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787882486.582589:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563938432:0@lo:501: 00000100:00100000:2.0:1787882486.582626:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563938560:0@lo:503: 00000100:00100000:2.0:1787882486.582682:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882486.582713:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787882486.582734:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563938560 00000100:00100000:1.0:1787882486.582739:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563938560 00000100:00100000:1.0:1787882486.582776:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787882486.582784:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563938560:12345-0@lo:503: 00000100:00100000:1.0:1787882486.583205:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563938560:12345-0@lo:503: Request processed in 421us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882486.583213:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787882486.583636:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563938560:0@lo:503: 00000100:00100000:2.0:1787882486.586130:0:7103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7103:1874730563938688:0@lo:502: 00000100:00100000:2.0:1787882486.586223:0:7103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882486.586275:0:7103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882486.586276:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563938688 00000100:00100000:1.0:1787882486.586285:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563938688 00000100:00100000:1.0:1787882486.586342:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787882486.586354:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:7103:x1874730563938688:12345-0@lo:502: 00000100:00100000:1.0:1787882486.586723:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:7103:x1874730563938688:12345-0@lo:502: Request processed in 370us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882486.586731:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787882486.586738:0:7103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7103:1874730563938688:0@lo:502: 00000020:01000000:2.0:1787882486.586768:0:7103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787882486.586777:0:7103:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787882486.586784:0:7103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882486.586786:0:7103:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787882486.586791:0:7103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787882486.586795:0:7103:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:2.0:1787882486.586818:0:7103:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787882486.586820:0:7103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787882486.586837:0:7103:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fa2c1238000) 00000020:00000080:2.0:1787882486.586860:0:7103:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787882486.586866:0:7103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787882486.586986:0:7103:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787882486.586992:0:7103:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787882486.587000:0:7103:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5dec4d 00010000:00080000:2.0:1787882486.587034:0:7103:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa2af875000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:2.0:1787882486.587283:0:7103:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787882486.673739:0:7103:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787882486.673772:0:7103:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787882486.674388:0:7103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787882486.675298:0:7103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787882486.675362:0:7103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787882486.675597:0:7103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787882486.676490:0:7111:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787882486.676496:0:7111:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787882486.678929:0:7103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787882486.678948:0:7103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787882486.678994:0:7103:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787882486.679020:0:7103:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4731e8a7c5dec54 00000100:00080000:0.0:1787882486.679032:0:7103:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787882486.679038:0:7103:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa2af875000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1787882486.679090:0:7103:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2af84a680 x1874730563938816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787882486.679114:0:7103:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787882486.679196:0:7103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787882486.679201:0:7103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882486.679203:0:7103:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787882486.679206:0:7103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787882486.679210:0:7103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882486.679212:0:7103:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787882486.679216:0:7103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787882486.679218:0:7103:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787882486.679251:0:7103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7103:1874730563938944:0@lo:502: 00000100:00100000:0.0:1787882486.679341:0:7103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882486.679391:0:7103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287a4b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787882486.679680:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563938944 00000100:00100000:0.0:1787882486.679689:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563938944 00000100:00100000:0.0:1787882486.679792:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787882486.679805:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:7103:x1874730563938944:12345-0@lo:502: 00000100:00100000:0.0:1787882486.680390:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:7103:x1874730563938944:12345-0@lo:502: Request processed in 584us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882486.680400:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787882486.680662:0:7103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7103:1874730563938944:0@lo:502: 00000020:01000000:0.0:1787882486.680696:0:7103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787882486.680703:0:7103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882486.680704:0:7103:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787882486.680713:0:7103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787882486.681958:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787882486.681992:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787882486.682005:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882486.682018:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882486.682028:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787882486.682031:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa297fcb370 from 1 10000000:01000000:3.0:1787882486.682034:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787882486.682061:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882486.682069:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882486.682092:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882486.682116:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563939328:0@lo:101: 00000100:00100000:3.0:1787882486.682181:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882486.682202:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563939072:0@lo:400: 00000100:00100000:3.0:1787882486.682219:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787882486.682235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882486.682236:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563939200:0@lo:400: 00000100:00100000:2.0:1787882486.682354:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730563938816:0@lo:8: 00000100:00100000:3.0:1787882486.682425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882486.682472:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563939328 00000100:00100000:3.0:1787882486.682480:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563939328 00000100:00100000:3.0:1787882486.682525:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787882486.682535:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563939328:12345-0@lo:101: 00010000:00010000:3.0:1787882486.682549:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882486.682563:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa281522600/0xf4731e8a7c5dec62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dec5b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882486.682590:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa281522600/0xf4731e8a7c5dec62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec5b expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882486.682601:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa281522600/0xf4731e8a7c5dec62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec5b expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882486.682611:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa281522600, rc 0) 00000100:00100000:0.0:1787882486.682626:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563939072 00000100:00100000:0.0:1787882486.682630:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563939072 00000100:00100000:3.0:1787882486.682660:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563939328:12345-0@lo:101: Request processed in 114us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882486.682667:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787882486.682707:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563939200 00000100:00100000:3.0:1787882486.682717:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563939200 00000100:00100000:3.0:1787882486.682754:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787882486.682761:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563939200:12345-0@lo:400: 00000100:00100000:3.0:1787882486.682800:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563939200:12345-0@lo:400: Request processed in 39us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882486.682807:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787882486.682826:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787882486.682857:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af6b5500 x1874730563939200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882486.682866:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787882486.682889:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563939200:0@lo:400: 00000100:00100000:3.0:1787882486.682917:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563939328:0@lo:101: 00010000:00010000:3.0:1787882486.682931:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882486.682942:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882486.682956:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563939072:12345-0@lo:400: 00000100:00100000:3.0:1787882486.682988:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563939456:0@lo:501: 00000100:00100000:0.0:1787882486.682992:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563939072:12345-0@lo:400: Request processed in 39us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882486.682998:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787882486.683011:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882486.683023:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749c00 going to sleep for 11 seconds 00010000:00080000:0.0:1787882486.683026:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af6b5880 x1874730563939072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882486.683032:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563939456 00000100:00100000:3.0:1787882486.683035:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563939456 00000100:00100000:0.0:1787882486.683036:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563939072:0@lo:400: 00000100:00100000:3.0:1787882486.683051:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787882486.683057:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa28660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563939456:12345-0@lo:501: 00000100:00100000:2.0:1787882486.683112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882486.683242:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563938816 00000100:00100000:0.0:1787882486.683246:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563938816 00000100:00100000:0.0:1787882486.683267:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882486.683272:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1874730563938816:12345-0@lo:8: 00010000:00080000:0.0:1787882486.683295:0:6709:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1787882486.683336:0:6709:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4731e8a7c5dec69 00000100:00100000:3.0:1787882486.683340:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa28660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563939456:12345-0@lo:501: Request processed in 283us (329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787882486.683347:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00002000:00100000:0.0:1787882486.683380:0:6709:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fa2bb1cd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787882486.683384:0:6709:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787882486.683389:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1787882486.683619:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563939456:0@lo:501: 10000000:01000000:2.0:1787882486.683707:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787882486.683716:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882486.683833:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1787882486.684096:0:6709:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787882486.684270:0:6709:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787882486.684308:0:6709:0:(import.c:65:import_set_state_nolock()) ffff9fa2bb1ce000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787882486.684377:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874730563938816:12345-0@lo:8: Request processed in 1103us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882486.684385:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787882486.684609:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af84a680 x1874730563938816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787882496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882486.684620:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787882486.684629:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787882486.684638:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787882486.684660:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787882486.684663:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2af875000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787882486.684686:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787882486.684691:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730563938816:0@lo:8: 00000004:00080000:2.0:1787882486.684729:0:7111:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787882486.684861:0:7111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 202833990626ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787882486.763860:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787882486.847233:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563939584:0@lo:13: 00000100:00100000:1.0:1787882486.847341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882486.847502:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563939584 00000100:00100000:3.0:1787882486.847513:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563939584 00000100:00100000:3.0:1787882486.847577:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787882486.847586:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730563939584:12345-0@lo:13: 00002000:00000024:3.0:1787882486.847623:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:2.0:1787882486.852296:0:7112:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787882486.852366:0:7112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7112:1874730563939712:0@lo:7: 00000100:00100000:2.0:1787882486.855125:0:7112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882486.855241:0:7112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787882486.855277:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730563939584:12345-0@lo:13: Request processed in 7524us (7769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882486.855296:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882486.855325:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563939712 00000100:00080000:3.0:1787882486.855349:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882486.855350:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563939712 00000100:00100000:0.0:1787882486.855496:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882486.855622:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7112:x1874730563939712:12345-0@lo:7: 00010000:00080000:1.0:1787882486.856120:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa29d8a2300 x1874730563939584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882486.856257:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563939584:0@lo:13: 00002000:00080000:1.0:1787882486.866267:0:6711:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787882486.866275:0:6711:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787882486.866377:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7112:x1874730563939712:12345-0@lo:7: Request processed in 10757us (11259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882486.866389:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787882486.866449:0:7112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa29d8a0a80 x1874730563939712/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787882502 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882486.866465:0:7112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7112:1874730563939712:0@lo:7: 00000004:00080000:2.0:1787882486.866478:0:7112:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787882486.866514:0:7112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7112:1874730563939840:0@lo:5: 00000100:00100000:2.0:1787882486.866548:0:7112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882486.866602:0:7112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787882486.866892:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563939840 00000100:00100000:0.0:1787882486.866905:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563939840 00000100:00100000:0.0:1787882486.866975:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787882486.866990:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7112:x1874730563939840:12345-0@lo:5: 00002000:00080000:0.0:1787882486.867025:0:6710:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787882486.867029:0:6710:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787882486.867417:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7112:x1874730563939840:12345-0@lo:5: Request processed in 432us (867us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787882486.867426:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787882486.867710:0:7112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa29d8a0a80 x1874730563939840/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787882502 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882486.867730:0:7112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7112:1874730563939840:0@lo:5: 00000004:00080000:2.0:1787882486.867743:0:7112:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787882486.867779:0:7112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7112:1874730563939968:0@lo:700: 00000100:00100000:2.0:1787882486.867863:0:7112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882486.867926:0:7112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787882486.869149:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563939968 00000100:00100000:0.0:1787882486.869167:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563939968 00000100:00100000:0.0:1787882486.869248:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882486.869263:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7112:x1874730563939968:12345-0@lo:700: 00000100:00100000:0.0:1787882486.869342:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6717:1874730563940096:0@lo:700: 00000100:00100000:0.0:1787882486.869433:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882486.869473:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a999fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787882486.869501:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563940096 00000100:00100000:3.0:1787882486.869512:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563940096 00000100:00100000:3.0:1787882486.869569:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787882486.869578:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6717:x1874730563940096:12345-0@lo:700: 00010000:00010000:1.0:1787882486.890985:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:0.0:1787882486.925083:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787882486.942948:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6717:x1874730563940096:12345-0@lo:700: Request processed in 73359us (73503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882486.942971:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787882486.943041:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af84aa00 x1874730563940096/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787882502 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882486.943057:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6717:1874730563940096:0@lo:700: 40000000:02000000:0.0:1787882486.943071:0:6717:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787882487.074301:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7112:x1874730563939968:12345-0@lo:700: Request processed in 205030us (206425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882487.074326:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1787882487.074376:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1787882487.074390:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1787882487.074521:0:7112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa29d8a1500 x1874730563939968/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787882502 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882487.074540:0:7112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7112:1874730563939968:0@lo:700: 00000004:02000040:2.0:1787882487.166197:0:7112:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787882487.176200:0:7112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7112:1874730563940224:0@lo:5: 00000100:00100000:3.0:1787882487.176305:0:7112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882487.176418:0:7112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28601af00 going to sleep for 11 seconds 00000100:00100000:1.0:1787882487.177177:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563940224 00000100:00100000:1.0:1787882487.177189:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563940224 00000100:00100000:1.0:1787882487.177249:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787882487.177260:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7112:x1874730563940224:12345-0@lo:5: 00002000:00080000:2.0:1787882487.196058:0:6711:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787882487.196081:0:6711:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787882487.200291:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7112:x1874730563940224:12345-0@lo:5: Request processed in 23021us (23975us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787882487.200312:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787882487.202310:0:7112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af6b5500 x1874730563940224/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787882503 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882487.202764:0:7112:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787882487.202789:0:7112:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fa2af6b5500 x1874730563940224/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787882503 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882487.202804:0:7112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7112:1874730563940224:0@lo:5: 00000004:00080000:1.0:1787882487.202821:0:7112:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1787882487.914157:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882488.938150:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882489.962051:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882490.986158:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787882491.395223:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1787882491.692078:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563940736:0@lo:400: 00000100:00100000:1.0:1787882491.692435:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882491.692538:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787882491.692555:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563940352:0@lo:400: 00000100:00100000:1.0:1787882491.692589:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882491.692634:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563940480:0@lo:400: 00000100:00100000:1.0:1787882491.692663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882491.692682:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787882491.692687:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563940608:0@lo:400: 00000100:00100000:1.0:1787882491.692707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882491.692733:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563940352 00000100:00100000:1.0:1787882491.692740:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563940352 00000100:00100000:1.0:1787882491.692780:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787882491.692790:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3307:x1874730563940352:12345-0@lo:400: 00000100:00100000:1.0:1787882491.692839:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3307:x1874730563940352:12345-0@lo:400: Request processed in 50us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882491.692847:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787882491.692917:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563940352:0@lo:400: 00000100:00100000:3.0:1787882491.693048:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563940480 00000100:00100000:3.0:1787882491.693054:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563940480 00000100:00100000:3.0:1787882491.693083:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563940608 00000100:00100000:3.0:1787882491.693085:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563940608 00000100:00100000:3.0:1787882491.693114:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787882491.693133:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563940480:12345-0@lo:400: 00000100:00100000:3.0:1787882491.693177:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563940480:12345-0@lo:400: Request processed in 57us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882491.693191:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787882491.693212:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787882491.693218:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563940608:12345-0@lo:400: 00000100:00100000:3.0:1787882491.693247:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563940608:12345-0@lo:400: Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882491.693252:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787882491.693278:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787882491.693303:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af84e300 x1874730563940608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882491.693314:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563940608:0@lo:400: 00010000:00080000:3.0:1787882491.693325:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af84f100 x1874730563940480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882491.693334:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563940480:0@lo:400: 00000100:00100000:2.0:1787882491.694782:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563940736 00000100:00100000:2.0:1787882491.694794:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563940736 00000100:00100000:2.0:1787882491.694861:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787882491.694887:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563940736:12345-0@lo:400: 00000100:00100000:2.0:1787882491.694963:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563940736:12345-0@lo:400: Request processed in 95us (2530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882491.694970:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787882491.695038:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787882491.695113:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af84df80 x1874730563940736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882491.695136:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787882491.695156:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563940736:0@lo:400: 00010000:00010000:0.0:1787882492.014532:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882492.203050:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563940864:0@lo:13: 00000100:00100000:3.0:1787882492.203127:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882492.203319:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563940864 00000100:00100000:0.0:1787882492.203329:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563940864 00000100:00100000:0.0:1787882492.203385:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882492.203408:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563940864:12345-0@lo:13: 00002000:00000024:0.0:1787882492.203446:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882492.203501:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563940864:12345-0@lo:13: Request processed in 95us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882492.203509:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787882492.203564:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af6b4000 x1874730563940864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882492.203586:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563940864:0@lo:13: 00010000:00010000:1.0:1787882493.034027:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882494.058025:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882495.086265:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882496.109249:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882496.819715:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563941248:0@lo:400: 00000100:00100000:3.0:1787882496.819723:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563940992:0@lo:400: 00000100:00100000:0.0:1787882496.819777:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563941120:0@lo:400: 00000100:00100000:1.0:1787882496.823289:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882496.824421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882496.824641:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563941248 00000100:00100000:3.0:1787882496.824650:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563941248 00000100:00100000:3.0:1787882496.824717:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787882496.824729:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563941248:12345-0@lo:400: 00000100:00100000:3.0:1787882496.825053:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563941248:12345-0@lo:400: Request processed in 326us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882496.825062:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787882496.825169:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563940992 00000100:00100000:3.0:1787882496.825173:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563940992 00000100:00100000:3.0:1787882496.825204:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787882496.825212:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3305:x1874730563940992:12345-0@lo:400: 00000100:00100000:3.0:1787882496.825252:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3305:x1874730563940992:12345-0@lo:400: Request processed in 41us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882496.825259:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787882496.825304:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563940992:0@lo:400: 00010000:00080000:3.0:1787882496.825353:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af84dc00 x1874730563941248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882496.825365:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563941248:0@lo:400: 00000100:00100000:3.0:1787882496.825539:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787882496.825552:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563941376:0@lo:400: 00000100:00100000:3.0:1787882496.825603:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882496.825682:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563941376 00000100:00100000:1.0:1787882496.825687:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563941376 00000100:00100000:1.0:1787882496.825943:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787882496.825955:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563941376:12345-0@lo:400: 00000100:00100000:1.0:1787882496.826006:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563941376:12345-0@lo:400: Request processed in 54us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882496.826013:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787882496.826169:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af84ed80 x1874730563941376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882496.826180:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563941376:0@lo:400: 00000100:00080000:1.0:1787882496.829017:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787882496.829029:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882496.832441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882496.834992:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563941120 00000100:00100000:1.0:1787882496.835011:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563941120 00000100:00100000:1.0:1787882496.835086:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787882496.835098:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563941120:12345-0@lo:400: 00000100:00100000:1.0:1787882496.835192:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563941120:12345-0@lo:400: Request processed in 96us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882496.835199:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787882496.837973:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af84ea00 x1874730563941120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882496.838280:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563941120:0@lo:400: 00010000:00010000:3.0:1787882497.130395:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882497.322794:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563941504:0@lo:13: 00000100:00100000:3.0:1787882497.322986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882497.323071:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563941504 00000100:00100000:3.0:1787882497.323080:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563941504 00000100:00100000:3.0:1787882497.323128:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787882497.323138:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563941504:12345-0@lo:13: 00002000:00000024:3.0:1787882497.323175:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882497.323219:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563941504:12345-0@lo:13: Request processed in 81us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882497.323233:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787882497.323274:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af6b4000 x1874730563941504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882497.323293:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563941504:0@lo:13: 00000020:01000004:3.0:1787882497.975146:0:7647:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787882497.975150:0:7647:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787882497.975287:0:7647:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa2c174b000 00000020:01000004:3.0:1787882497.975303:0:7647:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787882497.975316:0:7647:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787882497.975331:0:7647:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fa2866ecd28) 00000020:00000080:3.0:1787882497.975348:0:7647:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787882497.989336:0:7647:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787882497.989784:0:7647:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787882498.009032:0:7647:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787882498.014007:0:7647:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787882498.014048:0:7647:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787882498.014107:0:7647:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787882498.014135:0:7647:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787882498.015168:0:7647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787882498.015181:0:7647:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787882498.015192:0:7647:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf4731e8a7c5dec77 00000020:01000004:3.0:1787882498.015201:0:7647:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787882498.015224:0:7647:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787882498.015228:0:7647:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787882498.015234:0:7647:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787882498.015257:0:7647:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787882498.015262:0:7647:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787882498.037841:0:7647:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787882498.037913:0:7647:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.121@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787882498.037919:0:7647:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787882498.037921:0:7647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787882498.037922:0:7647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882498.037923:0:7647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882498.037924:0:7647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882498.037925:0:7647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882498.037927:0:7647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787882498.037929:0:7647:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787882498.037930:0:7647:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787882498.037932:0:7647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882498.037933:0:7647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787882498.037938:0:7647:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787882498.037940:0:7647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787882498.037941:0:7647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787882498.037942:0:7647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882498.037943:0:7647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882498.037945:0:7647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882498.037946:0:7647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882498.037947:0:7647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787882498.037948:0:7647:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787882498.037949:0:7647:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787882498.037950:0:7647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882498.037951:0:7647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787882498.037978:0:7647:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787882498.037997:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563941632:0@lo:253: 00000100:00100000:2.0:1787882498.038081:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.038216:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298a17c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787882498.038433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563941632 00000100:00100000:3.0:1787882498.038441:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563941632 00000100:00100000:3.0:1787882498.038536:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787882498.038547:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa28660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:7647:x1874730563941632:12345-0@lo:253: 20000000:01000000:3.0:1787882498.038578:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787882498.038582:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787882498.038597:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787882498.038601:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787882498.039969:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787882498.040261:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787882498.040280:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787882498.040318:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787882498.040325:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787882498.040353:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787882498.040482:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787882498.041071:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787882498.041096:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.121@tcp 20000000:01000000:3.0:1787882498.041098:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:3.0:1787882498.041132:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787882498.041140:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787882498.041265:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787882498.041275:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:3.0:1787882498.041308:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787882498.041318:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787882498.041346:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787882498.041490:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787882498.042564:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787882498.042600:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.121@tcp 20000000:01000000:3.0:1787882498.042603:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:3.0:1787882498.042640:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787882498.042647:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787882498.042711:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787882498.042720:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:3.0:1787882498.042753:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787882498.042762:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787882498.042803:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787882498.042837:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787882498.042855:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787882498.042858:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787882498.042866:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787882498.042909:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787882498.042912:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787882498.042926:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787882498.042929:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787882498.042967:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787882498.042969:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787882498.043795:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787882498.043851:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787882498.044021:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787882498.044350:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787882498.044407:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787882498.044439:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787882498.044454:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787882498.044457:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787882498.045214:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787882498.045280:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787882498.045312:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787882498.045682:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787882498.045723:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787882498.045774:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787882498.045789:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787882498.045791:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787882498.046275:0:7651:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787882498.046317:0:7651:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787882498.046490:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787882498.046721:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787882498.046757:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787882498.046807:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787882498.046820:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787882498.046822:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787882498.047220:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787882498.047535:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787882498.047575:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787882498.047648:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1787882498.047667:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787882498.047695:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.047713:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa281523000/0xf4731e8a7c5debcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5debc8 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.047722:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa281522e00/0xf4731e8a7c5debf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5debf2 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.047729:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813ffc00/0xf4731e8a7c5dec23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec1c expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.047736:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dec3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec38 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.047743:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa281522600/0xf4731e8a7c5dec62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec5b expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.047751:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.047791:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa281522600/0xf4731e8a7c5dec62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dec5b expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.047807:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa281522600/0xf4731e8a7c5dec62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec5b expref: 16 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882498.047822:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874730563941760:0@lo:104: 00000100:00100000:1.0:1787882498.047922:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787882498.047978:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dec3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dec38 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.047997:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dec3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec38 expref: 16 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882498.048006:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874730563941888:0@lo:104: 00010000:00010000:1.0:1787882498.048031:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813ffc00/0xf4731e8a7c5dec23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dec1c expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.048039:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813ffc00/0xf4731e8a7c5dec23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec1c expref: 16 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882498.048048:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874730563942016:0@lo:104: 00010000:00010000:1.0:1787882498.048521:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa281522e00/0xf4731e8a7c5debf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5debf2 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.048532:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa281522e00/0xf4731e8a7c5debf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5debf2 expref: 16 pid: 5835 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882498.048542:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874730563942144:0@lo:104: 00010000:00010000:1.0:1787882498.048568:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa281523000/0xf4731e8a7c5debcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5debc8 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.048575:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa281523000/0xf4731e8a7c5debcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5debc8 expref: 16 pid: 5835 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882498.048583:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874730563942272:0@lo:104: 00000100:00100000:1.0:1787882498.048613:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.048723:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787882498.048763:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.048794:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.048804:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.048812:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.048823:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563941760 00000100:00100000:2.0:1787882498.048831:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563941760 00000100:00100000:2.0:1787882498.048865:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563941888 00000100:00100000:2.0:1787882498.048887:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563941888 00000100:00100000:2.0:1787882498.048900:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563942016 00000100:00100000:2.0:1787882498.048902:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563942016 00000100:00100000:2.0:1787882498.048910:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563942144 00000100:00100000:2.0:1787882498.048913:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563942144 00000100:00100000:2.0:1787882498.048920:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563942272 00000100:00100000:2.0:1787882498.048921:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563942272 00000100:00100000:2.0:1787882498.048933:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787882498.048941:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d83c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+7:5838:x1874730563941760:12345-0@lo:104: 00010000:00010000:2.0:1787882498.048954:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.049010:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787882498.049016:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d83c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+7:5838:x1874730563941760:12345-0@lo:104: Request processed in 76us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.049024:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787882498.049070:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787882498.049076:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+6:5838:x1874730563941888:12345-0@lo:104: 00010000:00010000:2.0:1787882498.049084:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.049113:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787882498.049118:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+6:5838:x1874730563941888:12345-0@lo:104: Request processed in 43us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.049129:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787882498.049142:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787882498.049147:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+5:5838:x1874730563942016:12345-0@lo:104: 00010000:00010000:2.0:1787882498.049155:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.049258:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787882498.049263:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+5:5838:x1874730563942016:12345-0@lo:104: Request processed in 117us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.049270:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787882498.049282:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787882498.049288:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:5838:x1874730563942144:12345-0@lo:104: 00010000:00010000:2.0:1787882498.049296:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.049319:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787882498.049323:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:5838:x1874730563942144:12345-0@lo:104: Request processed in 36us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.049328:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787882498.049339:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787882498.049344:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5838:x1874730563942272:12345-0@lo:104: 00010000:00010000:2.0:1787882498.049350:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882498.049483:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874730563941760:0@lo:104: 00000100:00100000:1.0:1787882498.049503:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874730563941888:0@lo:104: 00000100:00100000:1.0:1787882498.049511:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874730563942016:0@lo:104: 00000100:00100000:1.0:1787882498.049517:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874730563942144:0@lo:104: 00010000:00010000:2.0:1787882498.049599:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787882498.049605:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5838:x1874730563942272:12345-0@lo:104: Request processed in 260us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.049618:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787882498.049691:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787882498.049699:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049707:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa281522200 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882498.049711:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049720:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882498.049727:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882498.049745:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787882498.049787:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049794:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882498.049815:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049823:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa281522200/0xf4731e8a7c5dec5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049836:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787882498.049840:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049845:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280030600 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882498.049848:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049855:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882498.049861:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882498.049891:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787882498.049905:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049910:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882498.049931:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049938:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5dec38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec3f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049948:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787882498.049951:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049957:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280030800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882498.049960:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049966:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882498.049972:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882498.049977:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787882498.049989:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.049995:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882498.050000:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050005:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dec1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec23 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050013:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787882498.050023:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050028:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813ffa00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882498.050030:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050036:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882498.050041:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882498.050045:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787882498.050057:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050062:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882498.050067:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050072:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5debf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5debf9 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050082:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882498.050085:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050090:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2c21c7400 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882498.050093:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050109:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882498.050114:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882498.050118:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787882498.050130:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050136:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882498.050140:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050145:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7400/0xf4731e8a7c5debc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5debcf expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050159:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882498.050161:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882498.050289:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874730563942272:0@lo:104: 00010000:00010000:1.0:1787882498.050316:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.050483:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882498.050501:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563942400:0@lo:103: 00000100:00100000:3.0:1787882498.050547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882498.050628:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563942912:0@lo:103: 00000100:00100000:3.0:1787882498.050648:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787882498.050948:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882498.051142:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787882498.051151:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563942784:0@lo:103: 00000100:00100000:3.0:1787882498.051188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.051306:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563942400 00000100:00100000:2.0:1787882498.051313:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563942400 00010000:00010000:2.0:1787882498.051344:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa281522600/0xf4731e8a7c5dec62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec5b expref: 17 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882498.051388:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563942912 00000100:00100000:0.0:1787882498.051392:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563942912 00010000:00010000:0.0:1787882498.051409:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa281523000/0xf4731e8a7c5debcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5debc8 expref: 18 pid: 5835 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882498.051459:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787882498.051468:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:3306:x1874730563942400:12345-0@lo:103: 00010000:00010000:0.0:1787882498.051481:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882498.051486:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa281522600/0xf4731e8a7c5dec62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec5b expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.051499:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa281522600/0xf4731e8a7c5dec62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec5b expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.051514:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa281522600/0xf4731e8a7c5dec62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dec5b expref: 18 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.051528:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882498.051560:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:3306:x1874730563942400:12345-0@lo:103: Request processed in 94us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882498.051567:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787882498.051597:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787882498.051603:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3306:x1874730563942912:12345-0@lo:103: 00010000:00010000:0.0:1787882498.051610:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882498.051615:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa281523000/0xf4731e8a7c5debcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5debc8 expref: 16 pid: 5835 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.051623:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa281523000/0xf4731e8a7c5debcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5debc8 expref: 16 pid: 5835 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.051632:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa281523000/0xf4731e8a7c5debcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5debc8 expref: 16 pid: 5835 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.051652:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882498.051675:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:3306:x1874730563942912:12345-0@lo:103: Request processed in 73us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882498.051681:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787882498.054149:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563942400:0@lo:103: 00000100:00100000:0.0:1787882498.054301:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563942784 00000100:00100000:0.0:1787882498.054310:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563942784 00010000:00010000:0.0:1787882498.054349:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa281522e00/0xf4731e8a7c5debf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5debf2 expref: 15 pid: 5835 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882498.056335:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787882498.056356:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:3306:x1874730563942784:12345-0@lo:103: 00010000:00010000:0.0:1787882498.056495:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882498.056506:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa281522e00/0xf4731e8a7c5debf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5debf2 expref: 15 pid: 5835 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.056522:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa281522e00/0xf4731e8a7c5debf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5debf2 expref: 15 pid: 5835 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.056544:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa281522e00/0xf4731e8a7c5debf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5debf2 expref: 15 pid: 5835 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.056568:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882498.056660:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:3306:x1874730563942784:12345-0@lo:103: Request processed in 316us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882498.056667:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787882498.056846:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563942912:0@lo:103: 00000100:00100000:3.0:1787882498.056899:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563942784:0@lo:103: 00000100:00100000:3.0:1787882498.056930:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563942528:0@lo:103: 00000100:00100000:3.0:1787882498.056973:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882498.057016:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787882498.057023:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563942656:0@lo:103: 00000100:00100000:3.0:1787882498.057044:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882498.057274:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563942528 00000100:00100000:0.0:1787882498.057281:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563942528 00010000:00010000:0.0:1787882498.057311:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dec3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec38 expref: 14 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882498.057349:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563942656 00000100:00100000:0.0:1787882498.057352:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563942656 00000100:00100000:1.0:1787882498.057498:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787882498.057510:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:3307:x1874730563942528:12345-0@lo:103: 00010000:00010000:1.0:1787882498.057524:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882498.057530:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dec3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec38 expref: 15 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.057543:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dec3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec38 expref: 15 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.057560:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dec3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dec38 expref: 15 pid: 5838 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.057575:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882498.057637:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:3307:x1874730563942528:12345-0@lo:103: Request processed in 130us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882498.057645:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787882498.057949:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813ffc00/0xf4731e8a7c5dec23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec1c expref: 13 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882498.057973:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787882498.057981:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:3307:x1874730563942656:12345-0@lo:103: 00010000:00010000:0.0:1787882498.057989:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882498.057993:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813ffc00/0xf4731e8a7c5dec23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec1c expref: 13 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058002:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813ffc00/0xf4731e8a7c5dec23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec1c expref: 13 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058013:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813ffc00/0xf4731e8a7c5dec23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dec1c expref: 13 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058027:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058035:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058052:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058059:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058066:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058082:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058088:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2c21c6000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882498.058093:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058101:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058115:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.058125:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882498.058156:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3307:x1874730563942656:12345-0@lo:103: Request processed in 177us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882498.058456:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563942656:0@lo:103: 00000100:00100000:3.0:1787882498.058468:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563942528:0@lo:103: 00000100:00100000:0.0:1787882498.058571:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787882498.058641:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.058650:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.058669:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec7e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787882498.058684:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787882498.102894:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa28660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:7647:x1874730563941632:12345-0@lo:253: Request processed in 64314us (64778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882498.102910:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787882498.103038:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563941632:0@lo:253: 10000000:01000000:2.0:1787882498.103055:0:7647:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787882498.103058:0:7647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787882498.103061:0:7647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787882498.103062:0:7647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882498.103063:0:7647:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787882498.103065:0:7647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882498.103066:0:7647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882498.103068:0:7647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787882498.103070:0:7647:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787882498.103072:0:7647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882498.103073:0:7647:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787882498.103094:0:7647:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa2c174b000 from lustre-OST0001 10000000:01000000:2.0:1787882498.103119:0:7647:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787882498.103122:0:7647:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787882498.103131:0:7647:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa297fcb370 local copy 10000000:01000000:2.0:1787882498.103135:0:7647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787882498.103186:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.103198:0:7647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.103207:0:7647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882498.103226:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943040:0@lo:101: 00000100:00100000:2.0:1787882498.103275:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.103302:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787882498.103490:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563943040 00000100:00100000:3.0:1787882498.103496:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563943040 00000100:00100000:3.0:1787882498.103542:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787882498.103551:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+11:7647:x1874730563943040:12345-0@lo:101: 00010000:00010000:3.0:1787882498.103563:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882498.103578:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b67cfa00/0xf4731e8a7c5dec8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dec85 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.103611:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67cfa00/0xf4731e8a7c5dec8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec85 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.103621:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b67cfa00/0xf4731e8a7c5dec8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec85 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.103629:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cfa00, rc 0) 00000100:00100000:3.0:1787882498.103670:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943040:12345-0@lo:101: Request processed in 120us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882498.103688:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787882498.103807:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943040:0@lo:101: 00010000:00010000:2.0:1787882498.103820:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.103830:0:7647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882498.103956:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943168:0@lo:501: 00000100:00100000:2.0:1787882498.103984:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.104001:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787882498.104053:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563943168 00000100:00100000:1.0:1787882498.104058:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563943168 00000100:00100000:1.0:1787882498.104088:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787882498.104095:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943168:12345-0@lo:501: 00000100:00100000:1.0:1787882498.104293:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943168:12345-0@lo:501: Request processed in 197us (307us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787882498.104301:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787882498.104495:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943168:0@lo:501: 10000000:01000000:2.0:1787882498.104509:0:7647:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787882498.104535:0:7647:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787882498.104542:0:7647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.104549:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.104555:0:7647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.104582:0:7647:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787882498.104611:0:7647:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa2c174b000 10000000:01000000:2.0:1787882498.104616:0:7647:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787882498.104621:0:7647:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787882498.104630:0:7647:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787882498.104634:0:7647:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787882498.104637:0:7647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787882498.104655:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.104663:0:7647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.104671:0:7647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882498.104684:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943296:0@lo:101: 00000100:00100000:2.0:1787882498.104713:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.104727:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158300 going to sleep for 11 seconds 00010000:00010000:1.0:1787882498.104781:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882498.104788:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.104795:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813ff000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882498.104799:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.104808:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882498.104815:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882498.104831:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882498.104849:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.104855:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882498.104902:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.104909:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2813ff000/0xf4731e8a7c5dec85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4731e8a7c5dec8c expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.104921:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882498.104923:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882498.104925:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882498.104934:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563943296 00000100:00100000:1.0:1787882498.104938:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563943296 00000100:00100000:1.0:1787882498.104963:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787882498.104970:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943296:12345-0@lo:101: 00010000:00010000:1.0:1787882498.104978:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882498.104988:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dec93 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.105005:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec93 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.105015:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec93 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.105023:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2c21c6000, rc 0) 00000100:00100000:1.0:1787882498.105057:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563943296:12345-0@lo:101: Request processed in 88us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882498.105064:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787882498.105085:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787882498.105096:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563943424:0@lo:103: 00000100:00100000:1.0:1787882498.105121:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882498.105157:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563943424 00000100:00100000:2.0:1787882498.105269:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943296:0@lo:101: 00010000:00010000:2.0:1787882498.105279:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.105288:0:7647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882498.105353:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943552:0@lo:501: 00000100:00100000:2.0:1787882498.105393:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.105407:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158300 going to sleep for 11 seconds 00000100:00100000:1.0:1787882498.105494:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563943424 00000100:00100000:1.0:1787882498.105537:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787882498.105545:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:3308:x1874730563943424:12345-0@lo:103: 00010000:00010000:1.0:1787882498.105554:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882498.105566:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b67cfa00/0xf4731e8a7c5dec8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5dec85 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.105577:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882498.105618:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3308:x1874730563943424:12345-0@lo:103: Request processed in 74us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882498.105625:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787882498.105651:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563943424:0@lo:103: 00000100:00100000:1.0:1787882498.105666:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563943552 00000100:00100000:1.0:1787882498.105669:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563943552 00000100:00100000:1.0:1787882498.105683:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787882498.105688:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943552:12345-0@lo:501: 00000100:00100000:1.0:1787882498.105910:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943552:12345-0@lo:501: Request processed in 221us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882498.105917:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787882498.106052:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943552:0@lo:501: 00000100:00100000:2.0:1787882498.106080:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943680:0@lo:503: 00000100:00100000:2.0:1787882498.106119:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.106156:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158300 going to sleep for 11 seconds 00000100:00100000:1.0:1787882498.106271:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563943680 00000100:00100000:1.0:1787882498.106280:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563943680 00000100:00100000:1.0:1787882498.106311:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787882498.106318:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943680:12345-0@lo:503: 00000100:00100000:1.0:1787882498.106575:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943680:12345-0@lo:503: Request processed in 257us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882498.106582:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787882498.106663:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943680:0@lo:503: 00000040:00080000:2.0:1787882498.106985:0:7647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787882498.107045:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943808:0@lo:502: 00000100:00100000:2.0:1787882498.107083:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.107109:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158300 going to sleep for 11 seconds 00000100:00100000:3.0:1787882498.107183:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563943808 00000100:00100000:3.0:1787882498.107188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563943808 00000100:00100000:3.0:1787882498.107218:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787882498.107226:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943808:12345-0@lo:502: 00000100:00100000:3.0:1787882498.107492:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943808:12345-0@lo:502: Request processed in 134us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882498.107499:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787882498.107644:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943808:0@lo:502: 00000040:00080000:1.0:1787882498.107908:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787882498.107958:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787882498.107990:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787882498.108032:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787882498.108067:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787882498.108097:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787882498.108123:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943936:0@lo:502: 00000100:00100000:1.0:1787882498.108281:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882498.108353:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749180 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.108520:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563943936 00000100:00100000:2.0:1787882498.108527:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563943936 00000100:00100000:2.0:1787882498.108616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787882498.108625:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943936:12345-0@lo:502: 00000100:00100000:2.0:1787882498.108791:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563943936:12345-0@lo:502: Request processed in 167us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.108798:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787882498.108890:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563943936:0@lo:502: 00000040:00080000:1.0:1787882498.108984:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787882498.108994:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787882498.109562:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787882498.109570:0:7656:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787882498.109578:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882498.109581:0:7656:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787882498.109600:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787882498.109626:0:7656:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fa29d9f0000) 00000020:00000080:1.0:1787882498.109647:0:7656:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787882498.109654:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787882498.109726:0:7656:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa2c174b000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787882498.109734:0:7656:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787882498.109745:0:7656:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf4731e8a7c5deca8 00010000:00010000:1.0:1787882498.116894:0:7656:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787882498.117323:0:7656:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787882498.119831:0:7656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787882498.120130:0:7656:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787882498.124812:0:7656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787882498.125646:0:7656:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787882498.127153:0:7656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787882498.130442:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882498.130469:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882498.130472:0:7656:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787882498.130478:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882498.130483:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882498.130484:0:7656:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787882498.130488:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787882498.130490:0:7656:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787882498.130546:0:7656:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882498.130550:0:7656:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882498.130551:0:7656:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787882498.130555:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787882498.130732:0:7647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787882498.130762:0:7647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787882498.130787:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.130799:0:7647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882498.130809:0:7647:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2c174b000 from 1 10000000:01000000:2.0:1787882498.130812:0:7647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787882498.130853:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.130861:0:7647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.130927:0:7647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882498.130953:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944064:0@lo:101: 00000100:00100000:2.0:1787882498.131025:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.131068:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.131092:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563944064 00000100:00100000:2.0:1787882498.131099:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563944064 00000100:00100000:2.0:1787882498.131142:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787882498.131150:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:7647:x1874730563944064:12345-0@lo:101: 00010000:00010000:2.0:1787882498.131558:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882498.131575:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5decb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5decaf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.131612:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5decb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5decaf expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.131625:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5decb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5decaf expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.131636:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813fe000, rc 0) 00000100:00100000:2.0:1787882498.132276:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563944064:12345-0@lo:101: Request processed in 1123us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.132286:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787882498.132485:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944064:0@lo:101: 00010000:00010000:3.0:1787882498.132505:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.132516:0:7647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882498.132636:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944192:0@lo:501: 00000100:00100000:3.0:1787882498.132675:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882498.132707:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7155840 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.132829:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563944192 00000100:00100000:2.0:1787882498.132835:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563944192 00000100:00100000:2.0:1787882498.132921:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787882498.132930:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563944192:12345-0@lo:501: 00000100:00100000:2.0:1787882498.133152:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563944192:12345-0@lo:501: Request processed in 223us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.133160:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787882498.134016:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944192:0@lo:501: 00000100:00100000:3.0:1787882498.134061:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944320:0@lo:503: 00000100:00100000:3.0:1787882498.134118:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882498.134149:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7155840 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.134307:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563944320 00000100:00100000:2.0:1787882498.134313:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563944320 00000100:00100000:2.0:1787882498.134347:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787882498.134355:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563944320:12345-0@lo:503: 00000100:00100000:2.0:1787882498.134864:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563944320:12345-0@lo:503: Request processed in 509us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.134898:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787882498.135090:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944320:0@lo:503: 00000040:00080000:3.0:1787882498.135400:0:7647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787882498.135475:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944448:0@lo:502: 00000100:00100000:3.0:1787882498.135526:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882498.135565:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7155840 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.135770:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563944448 00000100:00100000:2.0:1787882498.135777:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563944448 00000100:00100000:2.0:1787882498.135818:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787882498.135825:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563944448:12345-0@lo:502: 00000100:00100000:2.0:1787882498.136034:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563944448:12345-0@lo:502: Request processed in 209us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.136042:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787882498.136141:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944448:0@lo:502: 00000040:00080000:0.0:1787882498.136417:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787882498.136469:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787882498.136496:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944576:0@lo:502: 00000100:00100000:0.0:1787882498.136539:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882498.136566:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298041a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.136692:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563944576 00000100:00100000:2.0:1787882498.136697:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563944576 00000100:00100000:2.0:1787882498.136731:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787882498.136738:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563944576:12345-0@lo:502: 00000100:00100000:2.0:1787882498.136859:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563944576:12345-0@lo:502: Request processed in 121us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.136866:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787882498.137046:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944576:0@lo:502: 00000040:00080000:0.0:1787882498.137125:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787882498.137135:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787882498.137693:0:7659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787882498.137711:0:7659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882498.137714:0:7659:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787882498.137720:0:7659:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa2c174b000 00000020:00000080:0.0:1787882498.137723:0:7659:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787882498.137745:0:7659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787882498.137748:0:7659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882498.137749:0:7659:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787882498.137751:0:7659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787882498.137861:0:7647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787882498.137898:0:7647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787882498.137917:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.137934:0:7647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882498.137992:0:7647:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787882498.137996:0:7647:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa2c174b000 10000000:01000000:2.0:1787882498.137999:0:7647:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa2c174b000 10000000:01000000:2.0:1787882498.138003:0:7647:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787882498.138009:0:7647:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa2c174b000 from 1 10000000:01000000:2.0:1787882498.138012:0:7647:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787882498.138042:0:7647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.138051:0:7647:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.138060:0:7647:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882498.138077:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944704:0@lo:101: 00000100:00100000:2.0:1787882498.138127:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.138154:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563944704 00000100:00100000:2.0:1787882498.138158:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563944704 00000100:00100000:2.0:1787882498.138204:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787882498.138211:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563944704:12345-0@lo:101: 00010000:00010000:2.0:1787882498.138222:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882498.138234:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5decc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5decbd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.138268:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5decc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5decbd expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.138279:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5decc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5decbd expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.138288:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813ff800, rc 0) 00000100:00100000:2.0:1787882498.138316:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:7647:x1874730563944704:12345-0@lo:101: Request processed in 105us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.138322:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787882498.138495:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.138515:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944704:0@lo:101: 00010000:00010000:2.0:1787882498.138529:0:7647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.138538:0:7647:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882498.138632:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944832:0@lo:501: 00000100:00100000:2.0:1787882498.138657:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.138678:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563944832 00000100:00100000:2.0:1787882498.138681:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563944832 00000100:00100000:2.0:1787882498.138702:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787882498.138708:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:7647:x1874730563944832:12345-0@lo:501: 00000100:00100000:2.0:1787882498.138944:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:7647:x1874730563944832:12345-0@lo:501: Request processed in 235us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.138952:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787882498.138988:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.138998:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944832:0@lo:501: 00000100:00100000:2.0:1787882498.139023:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944960:0@lo:503: 00000100:00100000:2.0:1787882498.139062:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.139080:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563944960 00000100:00100000:2.0:1787882498.139083:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563944960 00000100:00100000:2.0:1787882498.139101:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787882498.139106:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:7647:x1874730563944960:12345-0@lo:503: 00000100:00100000:2.0:1787882498.139571:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:7647:x1874730563944960:12345-0@lo:503: Request processed in 463us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.139578:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787882498.139630:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.139642:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563944960:0@lo:503: 00000040:00080000:2.0:1787882498.141332:0:7647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787882498.141515:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563945088:0@lo:502: 00000100:00100000:2.0:1787882498.141606:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.141652:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882498.142283:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563945088 00000100:00100000:3.0:1787882498.142292:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563945088 00000100:00100000:3.0:1787882498.142338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787882498.142347:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:7647:x1874730563945088:12345-0@lo:502: 00000100:00100000:3.0:1787882498.142695:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:7647:x1874730563945088:12345-0@lo:502: Request processed in 347us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882498.142704:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787882498.142826:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563945088:0@lo:502: 00000040:00080000:2.0:1787882498.143140:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787882498.144783:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787882498.144838:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787882498.146202:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787882498.146528:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787882498.146594:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787882498.146630:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787882498.146665:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787882498.146725:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787882498.146772:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787882498.146803:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787882498.146846:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787882498.146914:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787882498.146952:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787882498.147028:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787882498.147063:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787882498.147093:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787882498.147138:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787882498.147183:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787882498.147216:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787882498.147259:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787882498.147291:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787882498.147319:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787882498.149124:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787882498.149503:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787882498.149539:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787882498.149615:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787882498.149651:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787882498.149999:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787882498.150050:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787882498.150105:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787882498.150136:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787882498.150898:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787882498.150993:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787882498.151031:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787882498.151077:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787882498.151110:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787882498.151174:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563945216:0@lo:502: 00000100:00100000:2.0:1787882498.151256:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.151308:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882498.151780:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563945216 00000100:00100000:0.0:1787882498.151789:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563945216 00000100:00100000:0.0:1787882498.151844:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787882498.151854:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:7647:x1874730563945216:12345-0@lo:502: 00000100:00100000:0.0:1787882498.152116:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:7647:x1874730563945216:12345-0@lo:502: Request processed in 262us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882498.152123:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787882498.152272:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563945216:0@lo:502: 00000040:00080000:2.0:1787882498.152391:0:7647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787882498.152406:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787882498.153470:0:7661:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787882498.153487:0:7661:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fa2c12399b8) 00000020:00000080:2.0:1787882498.153509:0:7661:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787882498.153599:0:7661:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa2c174b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787882498.153604:0:7661:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa2c174b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787882498.153606:0:7661:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa2c174b000 3 00010000:00080000:2.0:1787882498.153635:0:7661:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa2b9a03000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.121@tcp at head 00010000:00010000:2.0:1787882498.155952:0:7661:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1787882498.156159:0:7661:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787882498.156208:0:7661:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787882498.156220:0:7661:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf4731e8a7c5decd2 00000100:00080000:2.0:1787882498.156231:0:7661:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787882498.156238:0:7661:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fa2b9a03000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1787882498.156273:0:7661:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa29d8a1880 x1874730563945344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787882498.156309:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874730563945344:0@lo:38: 00000100:00100000:2.0:1787882498.156389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.156456:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563945344 00000100:00100000:2.0:1787882498.156464:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563945344 00000100:00100000:2.0:1787882498.156493:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787882498.156501:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874730563945344:12345-0@lo:38: 00010000:00080000:2.0:1787882498.156524:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:2.0:1787882498.156560:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf4731e8a7c5decd9 00000004:00100000:2.0:1787882498.156575:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787882498.156621:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9fa2af870800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787882498.156677:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874730563945344:12345-0@lo:38: Request processed in 174us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.156684:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787882498.156724:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d8a1880 x1874730563945344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787882508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882498.156734:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787882498.156742:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787882498.156748:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00010000:00010000:3.0:1787882498.156908:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787882498.157138:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787882498.157142:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2b9a03000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787882498.157150:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874730563945344:0@lo:38: 00000100:00080000:2.0:1787882498.157226:0:7661:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1787882498.157733:0:7661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1787882498.157844:0:7647:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787882498.157895:0:7647:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787882498.157909:0:7647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882498.157921:0:7647:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787882498.157967:0:7647:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787882498.157969:0:7647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787882498.157971:0:7647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787882498.157972:0:7647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787882498.157974:0:7647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787882498.157975:0:7647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787882498.157977:0:7647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787882498.157979:0:7647:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787882498.157980:0:7647:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787882498.157982:0:7647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787882498.157983:0:7647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787882498.157988:0:7647:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787882498.157990:0:7647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787882498.157995:0:7647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787882498.157996:0:7647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787882498.157997:0:7647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787882498.157998:0:7647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787882498.157999:0:7647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787882498.158000:0:7647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787882498.158001:0:7647:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787882498.158002:0:7647:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787882498.158003:0:7647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787882498.158004:0:7647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787882498.158024:0:7647:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787882498.158041:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563945472:0@lo:253: 00000100:00100000:3.0:1787882498.158101:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882498.158135:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7155240 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.158218:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563945472 00000100:00100000:2.0:1787882498.158227:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563945472 00000100:00100000:2.0:1787882498.158274:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787882498.158284:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:7647:x1874730563945472:12345-0@lo:253: 20000000:01000000:2.0:1787882498.158309:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787882498.158325:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787882498.158813:0:7662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7662:1874730563945600:0@lo:901: 00000100:00100000:2.0:1787882498.158854:0:7662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882498.158908:0:7662:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158480 going to sleep for 11 seconds 00000100:00100000:1.0:1787882498.163246:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563945600 00000100:00100000:1.0:1787882498.163260:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563945600 00000100:00100000:1.0:1787882498.163323:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787882498.163334:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7662:x1874730563945600:12345-0@lo:901: 00000100:00100000:1.0:1787882498.163757:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7662:x1874730563945600:12345-0@lo:901: Request processed in 424us (4900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882498.163766:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787882498.163861:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563945728:0@lo:400: 00000100:00100000:1.0:1787882498.163931:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882498.163970:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563945856:0@lo:400: 00000100:00100000:1.0:1787882498.164005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882498.164025:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787882498.164030:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563945984:0@lo:400: 00000100:00100000:1.0:1787882498.164052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882498.164078:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563945728 00000100:00100000:1.0:1787882498.164083:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563945728 00000100:00100000:1.0:1787882498.164108:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563945856 00000100:00100000:1.0:1787882498.164111:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563945856 00000100:00100000:1.0:1787882498.164129:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787882498.164136:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563945728:12345-0@lo:400: 00000100:00100000:1.0:1787882498.164171:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563945728:12345-0@lo:400: Request processed in 35us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882498.164178:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787882498.164189:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787882498.164194:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563945856:12345-0@lo:400: 00000100:00100000:1.0:1787882498.164220:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563945856:12345-0@lo:400: Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882498.164226:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787882498.164243:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563945984 00000100:00100000:1.0:1787882498.164247:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563945984 00000100:00100000:1.0:1787882498.164270:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787882498.164276:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563945984:12345-0@lo:400: 00000100:00100000:1.0:1787882498.164302:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563945984:12345-0@lo:400: Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882498.164308:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787882498.164344:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af84ea00 x1874730563945728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882498.164372:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563945728:0@lo:400: 00010000:00080000:1.0:1787882498.164401:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af84c700 x1874730563945984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882498.164409:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563945984:0@lo:400: 00010000:00080000:1.0:1787882498.164418:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af84d500 x1874730563945856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882498.164425:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563945856:0@lo:400: 00010000:00080000:1.0:1787882498.164470:0:7662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d8a1880 x1874730563945600/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787882514 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882498.164479:0:7662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7662:1874730563945600:0@lo:901: 00000100:00080000:0.0:1787882498.164814:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787882498.164820:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1787882498.187114:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787882498.187135:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787882498.187274:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787882498.187279:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787882498.187301:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.187320:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5dec31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec2a expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.187330:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.187380:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5dec31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dec2a expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882498.187397:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5dec31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec2a expref: 14 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882498.187429:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874730563946112:0@lo:104: 00000100:00100000:0.0:1787882498.187503:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882498.187554:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a07a4300 going to sleep for 11 seconds 00000100:00100000:2.0:1787882498.187702:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563946112 00000100:00100000:2.0:1787882498.187709:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563946112 00000100:00100000:2.0:1787882498.187761:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787882498.187770:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5860:x1874730563946112:12345-0@lo:104: 00010000:00010000:2.0:1787882498.187791:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882498.187845:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787882498.187851:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:5860:x1874730563946112:12345-0@lo:104: Request processed in 82us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882498.187858:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787882498.188060:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1874730563946112:0@lo:104: 00010000:00010000:0.0:1787882498.188080:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189461:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882498.189472:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189483:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882498.189487:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189497:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882498.189504:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882498.189511:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882498.189568:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189575:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882498.189615:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189623:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280031000/0xf4731e8a7c5dec2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189642:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882498.189644:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882498.189646:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882498.189654:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787882498.189669:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563946240:0@lo:103: 00000100:00100000:1.0:1787882498.189729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882498.189779:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563946240 00000100:00100000:1.0:1787882498.189786:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563946240 00010000:00010000:1.0:1787882498.189812:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5dec31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec2a expref: 15 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882498.189838:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787882498.189846:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286601c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:3308:x1874730563946240:12345-0@lo:103: 00010000:00010000:1.0:1787882498.189858:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882498.189863:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5dec31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec2a expref: 15 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189906:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5dec31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec2a expref: 15 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189919:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5dec31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dec2a expref: 15 pid: 5837 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189942:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189951:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787882498.189967:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002689140s 00010000:00010000:1.0:1787882498.189972:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189979:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189986:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189993:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.189999:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882498.190003:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.190010:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.190024:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.190034:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882498.190074:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286601c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:3308:x1874730563946240:12345-0@lo:103: Request processed in 228us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882498.190081:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787882498.190142:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563946240:0@lo:103: 00010000:00010000:1.0:1787882498.190252:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.190261:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882498.190268:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dece0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882498.197859:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:7647:x1874730563945472:12345-0@lo:253: Request processed in 39567us (39748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882498.197903:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787882498.198064:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8fe006bc-8a96-494d-a4af-8dd699ee0b84:7647:1874730563945472:0@lo:253: 10000000:01000000:0.0:1787882498.198081:0:7647:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787882498.198085:0:7647:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787882498.198087:0:7647:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787882498.198088:0:7647:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787882498.198089:0:7647:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787882498.198091:0:7647:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787882498.198092:0:7647:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787882498.198094:0:7647:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787882498.198095:0:7647:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787882498.198096:0:7647:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787882498.198099:0:7647:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787882498.198100:0:7647:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787882498.198116:0:7647:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787882498.203321:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787882498.203658:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787882498.203917:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787882498.204104:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787882498.204439:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787882498.204683:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787882498.206436:0:7647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787882498.494274:0:7647:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787882498.494281:0:7647:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787882498.494314:0:7647:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787882498.494396:0:7647:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787882498.494415:0:7647:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787882498.494446:0:7647:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787882499.182262:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882500.203942:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882501.226299:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882502.250041:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882502.446622:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563946368:0@lo:13: 00000100:00100000:3.0:1787882502.446692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882502.446768:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563946368 00000100:00100000:3.0:1787882502.446776:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563946368 00000100:00100000:3.0:1787882502.446831:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787882502.446841:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563946368:12345-0@lo:13: 00002000:00000024:3.0:1787882502.446893:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882502.446941:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563946368:12345-0@lo:13: Request processed in 101us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882502.446948:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787882502.447001:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af6b4000 x1874730563946368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882502.447021:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563946368:0@lo:13: 00000100:00080000:1.0:1787882502.453524:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787882503.274057:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882503.467508:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563946496:0@lo:400: 00000100:00100000:3.0:1787882503.467639:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882503.467689:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563947008:0@lo:400: 00000100:00100000:3.0:1787882503.467722:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882503.467752:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787882503.467757:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563946624:0@lo:400: 00000100:00100000:3.0:1787882503.467777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882503.467805:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563946752:0@lo:400: 00000100:00100000:3.0:1787882503.467827:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882503.467846:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787882503.467852:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563946880:0@lo:400: 00000100:00100000:3.0:1787882503.467897:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882503.467935:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563946496 00000100:00100000:3.0:1787882503.467942:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563946496 00000100:00100000:3.0:1787882503.467987:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787882503.467997:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:3305:x1874730563946496:12345-0@lo:400: 00000100:00100000:3.0:1787882503.468049:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:3305:x1874730563946496:12345-0@lo:400: Request processed in 53us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882503.468056:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787882503.468092:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563947008 00000100:00100000:3.0:1787882503.468096:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563947008 00000100:00100000:3.0:1787882503.468129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563946624 00000100:00100000:3.0:1787882503.468132:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563946624 00000100:00100000:3.0:1787882503.468158:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563946752 00000100:00100000:3.0:1787882503.468162:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563946752 00000100:00100000:3.0:1787882503.468176:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787882503.474241:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563946880 00000100:00100000:0.0:1787882503.474272:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563946880 00000100:00100000:0.0:1787882503.474825:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787882503.474840:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563946880:12345-0@lo:400: 00000100:00100000:0.0:1787882503.474965:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563946880:12345-0@lo:400: Request processed in 129us (7066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882503.474973:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787882503.475003:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787882503.475011:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563946624:12345-0@lo:400: 00000100:00100000:0.0:1787882503.475044:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563946624:12345-0@lo:400: Request processed in 34us (7265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882503.475050:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787882503.475066:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787882503.475073:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563946752:12345-0@lo:400: 00000100:00100000:0.0:1787882503.475097:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563946752:12345-0@lo:400: Request processed in 25us (7269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882503.475103:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787882503.475160:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af6b6a00 x1874730563946880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882503.475176:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563946880:0@lo:400: 00010000:00080000:0.0:1787882503.475188:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af6b7480 x1874730563946752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882503.475197:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563946752:0@lo:400: 00010000:00080000:0.0:1787882503.475233:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af6b7b80 x1874730563946624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882503.475242:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563946624:0@lo:400: 00000100:00100000:0.0:1787882503.475264:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563946496:0@lo:400: 00000100:00100000:3.0:1787882503.476791:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563947008:12345-0@lo:400: 00000100:00080000:3.0:1787882503.476818:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882503.476934:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563947008:12345-0@lo:400: Request processed in 8749us (9208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882503.476944:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787882503.476997:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af6b4380 x1874730563947008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882503.477013:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563947008:0@lo:400: 00010000:00010000:1.0:1787882504.300003:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787882505.033310:0:8003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787882505.329338:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882506.346806:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882507.370116:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882507.562209:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563947136:0@lo:13: 00000100:00100000:1.0:1787882507.563552:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.563818:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563947136 00000100:00100000:3.0:1787882507.563829:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563947136 00000100:00100000:3.0:1787882507.563912:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787882507.563922:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563947136:12345-0@lo:13: 00002000:00000024:3.0:1787882507.563964:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882507.564016:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563947136:12345-0@lo:13: Request processed in 96us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.564022:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:3.0:1787882507.564721:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787882507.564725:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa29d82f000 from 30 10000000:01000000:3.0:1787882507.564729:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787882507.564768:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.564778:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.564806:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882507.564826:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563947264:0@lo:101: 00000100:00100000:3.0:1787882507.564897:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.564933:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a99e3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787882507.565024:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563947264 00000100:00100000:2.0:1787882507.565030:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563947264 00000100:00100000:2.0:1787882507.565071:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787882507.565078:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563947264:12345-0@lo:101: 00010000:00010000:2.0:1787882507.565092:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882507.565105:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5decee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dece7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882507.565124:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5decee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dece7 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882507.565134:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5decee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dece7 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882507.565142:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813fe800, rc 0) 00000100:00100000:2.0:1787882507.565184:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563947264:12345-0@lo:101: Request processed in 106us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882507.565189:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787882507.565275:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563947264:0@lo:101: 00010000:00010000:0.0:1787882507.565289:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.565297:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882507.565351:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563947392:0@lo:501: 00000100:00100000:0.0:1787882507.565375:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.565396:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298ce3600 going to sleep for 11 seconds 00000100:00100000:3.0:1787882507.565497:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563947392 00000100:00100000:3.0:1787882507.565501:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563947392 00000100:00100000:3.0:1787882507.565530:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787882507.565548:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563947392:12345-0@lo:501: 00000100:00100000:3.0:1787882507.565900:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563947392:12345-0@lo:501: Request processed in 352us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.565907:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1787882507.568189:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787882507.568251:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af6b4380 x1874730563947136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882507.568275:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563947136:0@lo:13: 00000100:00100000:0.0:1787882507.568350:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563947392:0@lo:501: 00000100:00100000:0.0:1787882507.568399:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563947520:0@lo:503: 00000100:00100000:0.0:1787882507.568468:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.568516:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298ce3600 going to sleep for 11 seconds 00000100:00100000:3.0:1787882507.568769:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563947520 00000100:00100000:3.0:1787882507.568776:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563947520 00000100:00100000:3.0:1787882507.568831:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787882507.568850:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563947520:12345-0@lo:503: 00000100:00100000:3.0:1787882507.569224:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563947520:12345-0@lo:503: Request processed in 375us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.569231:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787882507.569472:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563947520:0@lo:503: 00000100:00100000:0.0:1787882507.570001:0:8107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8107:1874730563947648:0@lo:502: 00000100:00100000:0.0:1787882507.570050:0:8107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.570086:0:8107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298ce3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787882507.570959:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563947648 00000100:00100000:1.0:1787882507.570968:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563947648 00000100:00100000:1.0:1787882507.571029:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787882507.571039:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:8107:x1874730563947648:12345-0@lo:502: 00000100:00100000:1.0:1787882507.571403:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:8107:x1874730563947648:12345-0@lo:502: Request processed in 365us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882507.571416:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787882507.571552:0:8107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8107:1874730563947648:0@lo:502: 00000100:00100000:0.0:1787882507.571608:0:8107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8107:1874730563947776:0@lo:502: 00000100:00100000:0.0:1787882507.571644:0:8107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.571687:0:8107:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28809b540 going to sleep for 11 seconds 00000100:00100000:1.0:1787882507.572406:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563947776 00000100:00100000:1.0:1787882507.572413:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563947776 00000100:00100000:1.0:1787882507.572454:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787882507.572462:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:8107:x1874730563947776:12345-0@lo:502: 00000100:00100000:1.0:1787882507.572692:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:8107:x1874730563947776:12345-0@lo:502: Request processed in 229us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882507.572698:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787882507.572834:0:8107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8107:1874730563947776:0@lo:502: 00000040:00080000:3.0:1787882507.572899:0:8107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787882507.573134:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787882507.573152:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787882507.573162:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882507.573172:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882507.573182:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787882507.573185:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787882507.573187:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787882507.573214:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882507.573222:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882507.573232:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882507.573247:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563947904:0@lo:101: 00000100:00100000:1.0:1787882507.573289:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882507.573332:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787882507.573677:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563947904 00000100:00100000:0.0:1787882507.573683:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563947904 00000100:00100000:0.0:1787882507.573716:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787882507.573723:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563947904:12345-0@lo:101: 00010000:00010000:0.0:1787882507.573733:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882507.573744:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5decfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5decf5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.573765:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5decfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5decf5 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.573775:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5decfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5decf5 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.573784:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031800, rc 0) 00000100:00100000:0.0:1787882507.573821:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563947904:12345-0@lo:101: Request processed in 98us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882507.573827:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787882507.573897:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563947904:0@lo:101: 00010000:00010000:0.0:1787882507.573909:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.573918:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882507.573958:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563948032:0@lo:501: 00000100:00100000:0.0:1787882507.573980:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.573991:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28809b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787882507.574008:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563948032 00000100:00100000:0.0:1787882507.574012:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563948032 00000100:00100000:0.0:1787882507.574026:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787882507.574031:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563948032:12345-0@lo:501: 00000100:00100000:0.0:1787882507.574224:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563948032:12345-0@lo:501: Request processed in 192us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882507.574230:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787882507.574255:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563948032:0@lo:501: 00000100:00100000:0.0:1787882507.574276:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563948160:0@lo:503: 00000100:00100000:0.0:1787882507.574947:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.575007:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28809b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787882507.580739:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563948160 00000100:00100000:3.0:1787882507.580757:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563948160 00000100:00100000:3.0:1787882507.581771:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787882507.581792:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563948160:12345-0@lo:503: 00000100:00100000:3.0:1787882507.582294:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563948160:12345-0@lo:503: Request processed in 510us (7346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.582303:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787882507.582976:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563948160:0@lo:503: 00000100:00100000:2.0:1787882507.584196:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8108:1874730563948288:0@lo:502: 00000100:00100000:2.0:1787882507.584282:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882507.584339:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787882507.585108:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563948288 00000100:00100000:3.0:1787882507.585118:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563948288 00000100:00100000:3.0:1787882507.585163:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787882507.585172:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:8108:x1874730563948288:12345-0@lo:502: 00000100:00100000:3.0:1787882507.587028:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:8108:x1874730563948288:12345-0@lo:502: Request processed in 1849us (2738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.587041:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787882507.588241:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8108:1874730563948288:0@lo:502: 00000020:01000000:2.0:1787882507.589481:0:8108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787882507.589499:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882507.589501:0:8108:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787882507.589511:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787882507.589514:0:8108:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787882507.590479:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8108:1874730563948416:0@lo:502: 00000100:00100000:2.0:1787882507.590588:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882507.590646:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787882507.590963:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563948416 00000100:00100000:1.0:1787882507.590973:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563948416 00000100:00100000:1.0:1787882507.591025:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787882507.591035:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:8108:x1874730563948416:12345-0@lo:502: 00000100:00100000:1.0:1787882507.591272:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:8108:x1874730563948416:12345-0@lo:502: Request processed in 238us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882507.591279:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787882507.591896:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8108:1874730563948416:0@lo:502: 00000020:01000000:0.0:1787882507.591936:0:8108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787882507.591943:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882507.591946:0:8108:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787882507.591951:0:8108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787882507.593830:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787882507.593861:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787882507.594855:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.594944:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882507.594957:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787882507.594960:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa285a97800 from 30 10000000:01000000:3.0:1787882507.594963:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787882507.595010:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.595018:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.595029:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882507.595073:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563948544:0@lo:101: 00000100:00100000:3.0:1787882507.596605:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.596694:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a99e3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787882507.605545:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563948544 00000100:00100000:0.0:1787882507.605564:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563948544 00000100:00100000:0.0:1787882507.605629:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787882507.605650:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563948544:12345-0@lo:101: 00010000:00010000:0.0:1787882507.605669:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882507.605691:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5ded0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5ded03 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.605720:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5ded0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5ded03 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.605732:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5ded0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5ded03 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.605757:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031000, rc 0) 00000100:00100000:0.0:1787882507.605926:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563948544:12345-0@lo:101: Request processed in 287us (9326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882507.605934:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787882507.609644:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563948544:0@lo:101: 00010000:00010000:3.0:1787882507.609678:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.609691:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882507.609768:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563948672:0@lo:501: 00000100:00100000:3.0:1787882507.610070:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.610107:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a99e3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787882507.610131:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563948672 00000100:00100000:3.0:1787882507.610136:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563948672 00000100:00100000:3.0:1787882507.610175:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787882507.610182:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563948672:12345-0@lo:501: 00000100:00100000:3.0:1787882507.610936:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563948672:12345-0@lo:501: Request processed in 751us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.610946:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787882507.610995:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563948672:0@lo:501: 00000100:00100000:3.0:1787882507.611034:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563948800:0@lo:503: 00000100:00100000:3.0:1787882507.611071:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.611103:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6479480 going to sleep for 11 seconds 00000100:00100000:1.0:1787882507.611226:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563948800 00000100:00100000:1.0:1787882507.611232:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563948800 00000100:00100000:1.0:1787882507.611715:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787882507.611727:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563948800:12345-0@lo:503: 00000100:00100000:1.0:1787882507.611945:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563948800:12345-0@lo:503: Request processed in 220us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882507.611952:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787882507.612170:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563948800:0@lo:503: 00000100:00100000:1.0:1787882507.612826:0:8109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8109:1874730563948928:0@lo:502: 00000100:00100000:1.0:1787882507.612909:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882507.612983:0:8109:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882507.613041:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563948928 00000100:00100000:3.0:1787882507.613046:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563948928 00000100:00100000:3.0:1787882507.613080:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787882507.613087:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:8109:x1874730563948928:12345-0@lo:502: 00000100:00100000:3.0:1787882507.613614:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:8109:x1874730563948928:12345-0@lo:502: Request processed in 525us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.613623:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787882507.613704:0:8109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8109:1874730563948928:0@lo:502: 00000100:00100000:1.0:1787882507.613748:0:8109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8109:1874730563949056:0@lo:502: 00000100:00100000:1.0:1787882507.613784:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882507.613851:0:8109:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882507.613954:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563949056 00000100:00100000:2.0:1787882507.613959:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563949056 00000100:00100000:2.0:1787882507.613988:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787882507.613995:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:8109:x1874730563949056:12345-0@lo:502: 00000100:00100000:2.0:1787882507.614273:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:8109:x1874730563949056:12345-0@lo:502: Request processed in 277us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882507.614280:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787882507.616928:0:8109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8109:1874730563949056:0@lo:502: 00000040:00080000:1.0:1787882507.616980:0:8109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787882507.617163:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787882507.617192:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787882507.617204:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.617215:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882507.617223:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787882507.617226:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa285a97800 from 5 10000000:01000000:3.0:1787882507.617228:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787882507.617278:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.617286:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.617296:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882507.617317:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563949184:0@lo:101: 00000100:00100000:3.0:1787882507.617390:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.617452:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6479480 going to sleep for 11 seconds 00000100:00100000:0.0:1787882507.617516:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563949184 00000100:00100000:0.0:1787882507.617523:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563949184 00000100:00100000:0.0:1787882507.617584:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787882507.617593:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563949184:12345-0@lo:101: 00010000:00010000:0.0:1787882507.617605:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882507.617619:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280030800/0xf4731e8a7c5ded18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5ded11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.617642:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030800/0xf4731e8a7c5ded18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5ded11 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.617651:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280030800/0xf4731e8a7c5ded18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5ded11 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.617659:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030800, rc 0) 00000100:00100000:0.0:1787882507.617706:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563949184:12345-0@lo:101: Request processed in 114us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882507.617712:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787882507.618238:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563949184:0@lo:101: 00010000:00010000:3.0:1787882507.618263:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.618273:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882507.618326:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563949312:0@lo:256: 00000100:00100000:3.0:1787882507.618361:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.618404:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6479480 going to sleep for 11 seconds 00000100:00100000:1.0:1787882507.618502:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563949312 00000100:00100000:1.0:1787882507.618515:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563949312 00000100:00100000:1.0:1787882507.618562:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787882507.618571:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563949312:12345-0@lo:256: 20000000:01000000:1.0:1787882507.618587:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787882507.618602:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787882507.618605:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787882507.618690:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563949312:12345-0@lo:256: Request processed in 120us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882507.618697:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787882507.618944:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563949312:0@lo:256: 10000000:01000000:3.0:1787882507.618983:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787882507.618989:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.618997:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882507.619005:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787882507.619007:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787882507.619009:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787882507.619026:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.619033:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882507.619040:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882507.619055:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563949440:0@lo:101: 00000100:00100000:3.0:1787882507.619077:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.619097:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298a17cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882507.619156:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563949440 00000100:00100000:1.0:1787882507.619160:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563949440 00000100:00100000:1.0:1787882507.619189:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787882507.619195:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563949440:12345-0@lo:101: 00010000:00010000:1.0:1787882507.619202:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882507.619214:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2c21c7e00/0xf4731e8a7c5ded26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5ded1f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882507.619230:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2c21c7e00/0xf4731e8a7c5ded26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5ded1f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882507.619238:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2c21c7e00/0xf4731e8a7c5ded26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5ded1f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882507.619246:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2c21c7e00, rc 0) 00000100:00100000:1.0:1787882507.619574:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563949440:12345-0@lo:101: Request processed in 377us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882507.619581:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787882507.619693:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563949440:0@lo:101: 00010000:00010000:0.0:1787882507.619706:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.619715:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882507.619776:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563949568:0@lo:501: 00000100:00100000:0.0:1787882507.619804:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.619866:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298043c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787882507.620051:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563949568 00000100:00100000:3.0:1787882507.620057:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563949568 00000100:00100000:3.0:1787882507.620133:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787882507.620141:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563949568:12345-0@lo:501: 00000100:00100000:3.0:1787882507.620683:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563949568:12345-0@lo:501: Request processed in 541us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.620692:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787882507.620764:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563949568:0@lo:501: 00000100:00100000:0.0:1787882507.620798:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563949696:0@lo:503: 00000100:00100000:0.0:1787882507.620840:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.621318:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298043c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787882507.622998:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563949696 00000100:00100000:1.0:1787882507.623013:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563949696 00000100:00100000:1.0:1787882507.623085:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787882507.623096:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563949696:12345-0@lo:503: 00000100:00100000:1.0:1787882507.623825:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563949696:12345-0@lo:503: Request processed in 726us (2979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882507.623833:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787882507.623988:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563949696:0@lo:503: 00000100:00100000:0.0:1787882507.624809:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8110:1874730563949824:0@lo:502: 00000100:00100000:0.0:1787882507.624976:0:8110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.625013:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2980430c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882507.625055:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563949824 00000100:00100000:1.0:1787882507.625060:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563949824 00000100:00100000:1.0:1787882507.625098:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787882507.625106:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8110:x1874730563949824:12345-0@lo:502: 00000100:00100000:1.0:1787882507.625818:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8110:x1874730563949824:12345-0@lo:502: Request processed in 709us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882507.625827:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787882507.626050:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8110:1874730563949824:0@lo:502: 00000020:01000000:0.0:1787882507.626080:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787882507.626087:0:8110:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787882507.626094:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882507.626096:0:8110:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787882507.626100:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787882507.626103:0:8110:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:0.0:1787882507.626137:0:8110:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787882507.626141:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787882507.626156:0:8110:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fa2b7138000) 00000020:00000080:0.0:1787882507.626176:0:8110:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787882507.626185:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787882507.626253:0:8110:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787882507.626488:0:8110:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787882507.626576:0:8110:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5ded34 00010000:00080000:0.0:1787882507.626616:0:8110:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa2b553f800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1787882507.626852:0:8110:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787882507.627588:0:8110:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787882507.627603:0:8110:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787882507.628555:0:8110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787882507.628785:0:8110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787882507.628838:0:8110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787882507.629493:0:8110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787882507.629930:0:8111:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787882507.629936:0:8111:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787882507.631056:0:8110:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787882507.631070:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787882507.631104:0:8110:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787882507.631125:0:8110:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4731e8a7c5ded3b 00000100:00080000:0.0:1787882507.631135:0:8110:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787882507.631142:0:8110:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa2b553f800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1787882507.631178:0:8110:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2af849500 x1874730563949952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787882507.631240:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730563949952:0@lo:8: 00000100:00100000:2.0:1787882507.631486:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787882507.631561:0:8110:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787882507.631672:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787882507.631676:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882507.631678:0:8110:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787882507.631681:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787882507.631685:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882507.631686:0:8110:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787882507.631689:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787882507.631690:0:8110:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787882507.631716:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8110:1874730563950080:0@lo:502: 00000100:00100000:0.0:1787882507.631762:0:8110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.631780:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298043b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787882507.631898:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563949952 00000100:00100000:1.0:1787882507.631906:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563949952 00000100:00100000:1.0:1787882507.631938:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787882507.631946:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1874730563949952:12345-0@lo:8: 00010000:00080000:1.0:1787882507.631969:0:6711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:1.0:1787882507.631998:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4731e8a7c5ded42 00002000:00100000:1.0:1787882507.632015:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fa2bff79000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787882507.632019:0:6711:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787882507.632023:0:6711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787882507.632143:0:6711:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787882507.632344:0:6711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787882507.632369:0:6711:0:(import.c:65:import_set_state_nolock()) ffff9fa2bff7a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787882507.632617:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874730563949952:12345-0@lo:8: Request processed in 669us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882507.632625:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787882507.632735:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af849500 x1874730563949952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787882517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882507.632746:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787882507.632753:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787882507.632761:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787882507.632773:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787882507.632775:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2b553f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787882507.632800:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787882507.632806:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730563949952:0@lo:8: 00000004:00080000:2.0:1787882507.632830:0:8111:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787882507.632963:0:8111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 223782092906ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787882507.634323:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563950208:0@lo:400: 00000100:00100000:3.0:1787882507.635644:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.635701:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787882507.635711:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563950336:0@lo:400: 00000100:00100000:3.0:1787882507.635758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.635800:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563950464:0@lo:400: 00000100:00100000:3.0:1787882507.635824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.635859:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563950208 00000100:00100000:3.0:1787882507.635867:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563950208 00000100:00100000:3.0:1787882507.635928:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563950336 00000100:00100000:3.0:1787882507.635931:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563950336 00000100:00100000:3.0:1787882507.635954:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563950464 00000100:00100000:3.0:1787882507.635957:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563950464 00000100:00100000:3.0:1787882507.635973:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787882507.635982:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563950208:12345-0@lo:400: 00000100:00100000:3.0:1787882507.636040:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563950208:12345-0@lo:400: Request processed in 59us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.636060:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787882507.636079:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787882507.636086:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563950336:12345-0@lo:400: 00000100:00100000:3.0:1787882507.636114:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563950336:12345-0@lo:400: Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.636120:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787882507.636130:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787882507.636137:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563950464:12345-0@lo:400: 00000100:00100000:3.0:1787882507.636163:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563950464:12345-0@lo:400: Request processed in 27us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.636169:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787882507.636194:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787882507.636219:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af6b7b80 x1874730563950464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882507.636233:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563950464:0@lo:400: 00010000:00080000:3.0:1787882507.636262:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af6b4000 x1874730563950336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882507.636271:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563950336:0@lo:400: 00010000:00080000:3.0:1787882507.636281:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af6b4700 x1874730563950208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882507.636289:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563950208:0@lo:400: 00000100:00100000:3.0:1787882507.636311:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563950080 00000100:00100000:3.0:1787882507.636315:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563950080 00000100:00100000:3.0:1787882507.636342:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787882507.636356:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8110:x1874730563950080:12345-0@lo:502: 00000100:00100000:3.0:1787882507.636618:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8110:x1874730563950080:12345-0@lo:502: Request processed in 262us (4854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.636625:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787882507.642352:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8110:1874730563950080:0@lo:502: 00000020:01000000:0.0:1787882507.643283:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787882507.643294:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882507.643296:0:8110:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787882507.643301:0:8110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787882507.643595:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787882507.643612:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787882507.643623:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.643634:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882507.643645:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787882507.643647:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa297fcb370 from 1 10000000:01000000:0.0:1787882507.643650:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787882507.643683:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.643691:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.643700:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882507.643722:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563950592:0@lo:101: 00000100:00100000:0.0:1787882507.643791:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.643836:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298043b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882507.643856:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563950592 00000100:00100000:0.0:1787882507.643862:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563950592 00000100:00100000:0.0:1787882507.643928:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787882507.643947:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563950592:12345-0@lo:101: 00010000:00010000:0.0:1787882507.643958:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882507.643971:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5ded50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5ded49 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.643996:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5ded50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5ded49 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.644008:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5ded50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5ded49 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.644018:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030200, rc 0) 00000100:00100000:0.0:1787882507.644056:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563950592:12345-0@lo:101: Request processed in 110us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882507.644062:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787882507.644114:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563950592:0@lo:101: 00010000:00010000:0.0:1787882507.644127:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882507.644137:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882507.644184:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563950720:0@lo:501: 00000100:00100000:0.0:1787882507.644209:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882507.644227:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298043b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787882507.645988:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563950720 00000100:00100000:3.0:1787882507.646002:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563950720 00000100:00100000:3.0:1787882507.646086:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787882507.646096:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563950720:12345-0@lo:501: 00000100:00100000:3.0:1787882507.646368:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563950720:12345-0@lo:501: Request processed in 273us (2157us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787882507.646409:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563950720:0@lo:501: 10000000:01000000:1.0:1787882507.646451:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787882507.646462:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882507.646473:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882507.647859:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000004:00080000:2.0:1787882507.749937:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787882507.804672:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563950848:0@lo:13: 00000100:00100000:3.0:1787882507.804752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787882507.804959:0:8112:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787882507.804987:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1874730563950976:0@lo:7: 00000100:00100000:1.0:1787882507.805024:0:8112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882507.805052:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787882507.805074:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563950976 00000100:00100000:1.0:1787882507.805082:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563950976 00000100:00100000:1.0:1787882507.805146:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787882507.805157:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8112:x1874730563950976:12345-0@lo:7: 00000100:00100000:0.0:1787882507.806669:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563950848 00000100:00100000:0.0:1787882507.806683:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563950848 00000100:00100000:0.0:1787882507.806749:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787882507.806759:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730563950848:12345-0@lo:13: 00002000:00000024:0.0:1787882507.806808:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:3.0:1787882507.810064:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787882507.817595:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730563950848:12345-0@lo:13: Request processed in 10824us (12828us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882507.817611:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787882507.818435:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af84c700 x1874730563950848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882507.818529:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563950848:0@lo:13: 00002000:00080000:1.0:1787882507.822687:0:6709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787882507.822697:0:6709:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787882507.822819:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8112:x1874730563950976:12345-0@lo:7: Request processed in 17657us (17787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882507.822830:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787882507.823337:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af84ea00 x1874730563950976/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787882523 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882507.823353:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1874730563950976:0@lo:7: 00000004:00080000:2.0:1787882507.823378:0:8112:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787882507.823419:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1874730563951104:0@lo:5: 00000100:00100000:2.0:1787882507.823545:0:8112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882507.823617:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479840 going to sleep for 11 seconds 00000100:00100000:0.0:1787882507.823686:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563951104 00000100:00100000:0.0:1787882507.823695:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563951104 00000100:00100000:0.0:1787882507.823746:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787882507.823755:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8112:x1874730563951104:12345-0@lo:5: 00002000:00080000:0.0:1787882507.823784:0:6710:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787882507.823788:0:6710:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787882507.824137:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8112:x1874730563951104:12345-0@lo:5: Request processed in 382us (591us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787882507.824145:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787882507.824732:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d8a2680 x1874730563951104/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787882523 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882507.824749:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1874730563951104:0@lo:5: 00000004:00080000:2.0:1787882507.824765:0:8112:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787882507.824802:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1874730563951232:0@lo:700: 00000100:00100000:2.0:1787882507.824842:0:8112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882507.824910:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479840 going to sleep for 11 seconds 00000100:00100000:3.0:1787882507.825147:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563951232 00000100:00100000:3.0:1787882507.825153:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563951232 00000100:00100000:3.0:1787882507.825208:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787882507.825218:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8112:x1874730563951232:12345-0@lo:700: 00000100:00100000:3.0:1787882507.825253:0:6717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6717:1874730563951360:0@lo:700: 00000100:00100000:3.0:1787882507.825287:0:6717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882507.825328:0:6717:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298a17b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882507.825591:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563951360 00000100:00100000:0.0:1787882507.825596:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563951360 00000100:00100000:0.0:1787882507.825636:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882507.825645:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6717:x1874730563951360:12345-0@lo:700: 40000000:02000000:2.0:1787882507.891068:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787882507.899693:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6717:x1874730563951360:12345-0@lo:700: Request processed in 74041us (74396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882507.899708:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787882507.899809:0:6717:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af6b4000 x1874730563951360/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787882523 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882507.899824:0:6717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6717:1874730563951360:0@lo:700: 40000000:02000000:0.0:1787882507.899838:0:6717:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1787882507.986719:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787882507.986742:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787882507.987025:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8112:x1874730563951232:12345-0@lo:700: Request processed in 161805us (162178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882507.987043:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787882507.987136:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d8a2a00 x1874730563951232/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787882523 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882507.987148:0:8112:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787882507.987164:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1874730563951232:0@lo:700: 00000004:02000040:3.0:1787882508.064929:0:8112:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787882508.077919:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1874730563951488:0@lo:5: 00000100:00100000:3.0:1787882508.078000:0:8112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882508.078046:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287e006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882508.078644:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563951488 00000100:00100000:1.0:1787882508.078653:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563951488 00000100:00100000:1.0:1787882508.078702:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787882508.078712:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8112:x1874730563951488:12345-0@lo:5: 00002000:00080000:1.0:1787882508.102501:0:6709:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787882508.102523:0:6709:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787882508.116193:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8112:x1874730563951488:12345-0@lo:5: Request processed in 37474us (38184us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787882508.116206:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787882508.117947:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af6b4000 x1874730563951488/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787882524 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882508.117968:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1874730563951488:0@lo:5: 00000004:00080000:2.0:1787882508.117994:0:8112:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787882508.397571:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882509.418303:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787882510.357736:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787882510.446722:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882510.913043:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882510.913487:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541908096 00000100:00100000:1.0:1787882510.913497:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541908096 00000100:00100000:1.0:1787882510.913732:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 111 00000100:00100000:1.0:1787882510.913740:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2355:x1874730541908096:12345-192.168.206.21@tcp:250: 00010000:00080000:1.0:1787882510.913768:0:5838:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e20a5c6e-5239-47c9-94f6-23609a5ad5fb@192.168.206.21@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:1.0:1787882510.913798:0:5838:0:(genops.c:1385:class_connect()) connect: client e20a5c6e-5239-47c9-94f6-23609a5ad5fb, cookie 0xf4731e8a7c5ded57 00000100:00080000:1.0:1787882510.913956:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9fa2bff7c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787882510.914022:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+5:2355:x1874730541908096:12345-192.168.206.21@tcp:250: Request processed in 281us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882510.914031:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 111 00000100:00100000:3.0:1787882510.931101:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882510.931288:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541908224 00000100:00100000:2.0:1787882510.931305:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541908224 00000100:00100000:2.0:1787882510.931358:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 112 00000100:00100000:2.0:1787882510.931369:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+5:5597:x1874730541908224:12345-192.168.206.21@tcp:101: 00010000:00010000:2.0:1787882510.931394:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882510.931412:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5ded5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842ee8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882510.931440:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5ded5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ee8 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882510.931451:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5ded5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ee8 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882510.931460:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813fee00, rc 0) 00000100:00100000:2.0:1787882510.931531:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+6:5597:x1874730541908224:12345-192.168.206.21@tcp:101: Request processed in 164us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882510.931713:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 112 00000100:00100000:3.0:1787882510.933764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882510.933836:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541908352 00000100:00100000:1.0:1787882510.933845:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541908352 00000100:00100000:1.0:1787882510.936496:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00100000:1.0:1787882510.936533:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+6:5597:x1874730541908352:12345-192.168.206.21@tcp:501: 00000100:00100000:1.0:1787882510.936848:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+6:5597:x1874730541908352:12345-192.168.206.21@tcp:501: Request processed in 336us (3090us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787882510.936856:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00100000:0.0:1787882510.942461:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882510.942676:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541908480 00000100:00100000:2.0:1787882510.942686:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541908480 00000100:00100000:2.0:1787882510.942776:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 114 00000100:00100000:2.0:1787882510.942787:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+6:5597:x1874730541908480:12345-192.168.206.21@tcp:101: 00010000:00010000:2.0:1787882510.942803:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882510.942821:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813ff000/0xf4731e8a7c5ded65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842eef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882510.942846:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813ff000/0xf4731e8a7c5ded65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842eef expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882510.942857:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813ff000/0xf4731e8a7c5ded65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842eef expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882510.942887:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813ff000, rc 0) 00000100:00100000:2.0:1787882510.942946:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+7:5597:x1874730541908480:12345-192.168.206.21@tcp:101: Request processed in 161us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882510.942953:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 114 00000100:00100000:1.0:1787882510.946638:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882510.946768:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541908608 00000100:00100000:2.0:1787882510.946779:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541908608 00000100:00100000:2.0:1787882510.946829:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:2.0:1787882510.946838:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+7:5597:x1874730541908608:12345-192.168.206.21@tcp:501: 00000100:00100000:2.0:1787882510.947122:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:5597:x1874730541908608:12345-192.168.206.21@tcp:501: Request processed in 284us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882510.947130:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:3.0:1787882510.952649:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882510.952775:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541908736 00000100:00100000:2.0:1787882510.952796:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541908736 00000100:00100000:2.0:1787882510.952846:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:2.0:1787882510.952857:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:5597:x1874730541908736:12345-192.168.206.21@tcp:503: 00000100:00100000:2.0:1787882510.953727:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:5597:x1874730541908736:12345-192.168.206.21@tcp:503: Request processed in 868us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882510.953736:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:3.0:1787882510.967358:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882510.967997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541908864 00000100:00100000:2.0:1787882510.968007:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541908864 00000100:00100000:2.0:1787882510.968059:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 117 00000100:00100000:2.0:1787882510.968068:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:5615:x1874730541908864:12345-192.168.206.21@tcp:502: 00000100:00100000:2.0:1787882510.968397:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:5615:x1874730541908864:12345-192.168.206.21@tcp:502: Request processed in 320us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882510.968404:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 117 00000100:00100000:0.0:1787882511.009007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882511.009196:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541908992 00000100:00100000:2.0:1787882511.009205:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541908992 00000100:00100000:2.0:1787882511.009251:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:2.0:1787882511.009270:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:5615:x1874730541908992:12345-192.168.206.21@tcp:502: 00000100:00100000:2.0:1787882511.009535:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:5615:x1874730541908992:12345-192.168.206.21@tcp:502: Request processed in 275us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882511.009544:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:3.0:1787882511.012595:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882511.012823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541909120 00000100:00100000:2.0:1787882511.012832:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541909120 00000100:00100000:2.0:1787882511.012895:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 119 00000100:00100000:2.0:1787882511.012904:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:5597:x1874730541909120:12345-192.168.206.21@tcp:101: 00010000:00010000:2.0:1787882511.012919:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882511.012936:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5ded6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842f19 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882511.012970:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5ded6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f19 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882511.012981:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5ded6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f19 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882511.012989:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813fea00, rc 0) 00000100:00100000:2.0:1787882511.013036:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:5597:x1874730541909120:12345-192.168.206.21@tcp:101: Request processed in 133us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882511.013043:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 119 00000100:00100000:2.0:1787882511.022249:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882511.023136:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541909248 00000100:00100000:3.0:1787882511.023147:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541909248 00000100:00100000:3.0:1787882511.023201:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:3.0:1787882511.023212:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:5597:x1874730541909248:12345-192.168.206.21@tcp:256: 20000000:01000000:3.0:1787882511.023234:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787882511.023750:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787882511.023756:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787882511.023759:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787882511.023762:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787882511.026006:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:5597:x1874730541909248:12345-192.168.206.21@tcp:256: Request processed in 2786us (3760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882511.026020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:3.0:1787882511.029415:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882511.029632:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541909376 00000100:00100000:2.0:1787882511.029643:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541909376 00000100:00100000:2.0:1787882511.029770:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:2.0:1787882511.029781:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:5597:x1874730541909376:12345-192.168.206.21@tcp:101: 00010000:00010000:2.0:1787882511.029797:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882511.029834:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b7265400/0xf4731e8a7c5ded73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842f20 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882511.029864:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b7265400/0xf4731e8a7c5ded73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f20 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882511.029901:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b7265400/0xf4731e8a7c5ded73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f20 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882511.029911:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265400, rc 0) 00000100:00100000:2.0:1787882511.029965:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5597:x1874730541909376:12345-192.168.206.21@tcp:101: Request processed in 185us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882511.029979:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:0.0:1787882511.034217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882511.034495:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541909504 00000100:00100000:3.0:1787882511.034504:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541909504 00000100:00100000:3.0:1787882511.034571:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:3.0:1787882511.034580:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5597:x1874730541909504:12345-192.168.206.21@tcp:501: 00000100:00100000:3.0:1787882511.034971:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5597:x1874730541909504:12345-192.168.206.21@tcp:501: Request processed in 390us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882511.034985:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:1.0:1787882511.046492:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882511.046904:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541909632 00000100:00100000:2.0:1787882511.046915:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541909632 00000100:00100000:2.0:1787882511.046961:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:2.0:1787882511.046970:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5597:x1874730541909632:12345-192.168.206.21@tcp:503: 00000100:00100000:2.0:1787882511.048234:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5597:x1874730541909632:12345-192.168.206.21@tcp:503: Request processed in 1257us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882511.048247:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:1.0:1787882511.055909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882511.056448:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541909760 00000100:00100000:2.0:1787882511.056458:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541909760 00000100:00100000:2.0:1787882511.056506:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 124 00000100:00100000:2.0:1787882511.056527:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5617:x1874730541909760:12345-192.168.206.21@tcp:502: 00000100:00100000:2.0:1787882511.056803:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5617:x1874730541909760:12345-192.168.206.21@tcp:502: Request processed in 287us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882511.056812:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 124 00000100:00100000:2.0:1787882511.059567:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882511.059765:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541909888 00000100:00100000:3.0:1787882511.059774:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541909888 00000100:00100000:3.0:1787882511.059826:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:3.0:1787882511.059837:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5617:x1874730541909888:12345-192.168.206.21@tcp:502: 00000100:00100000:3.0:1787882511.060100:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5617:x1874730541909888:12345-192.168.206.21@tcp:502: Request processed in 264us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882511.060108:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:1.0:1787882511.076770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882511.080648:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541910016 00000100:00100000:3.0:1787882511.080664:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541910016 00000100:00100000:3.0:1787882511.080770:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:3.0:1787882511.080779:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1874730541910016:12345-192.168.206.21@tcp:38: 00010000:00080000:3.0:1787882511.080807:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:3.0:1787882511.080855:0:5845:0:(genops.c:1385:class_connect()) connect: client 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9, cookie 0xf4731e8a7c5ded7a 00000004:00100000:3.0:1787882511.080896:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787882511.080913:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787882511.129512:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9fa2b6466000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787882511.129619:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2355:x1874730541910016:12345-192.168.206.21@tcp:38: Request processed in 48837us (52858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882511.129630:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00010000:00010000:0.0:1787882511.467646:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882512.140602:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882512.140647:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882512.140749:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541910144 00000100:00100000:0.0:1787882512.140759:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541910144 00000100:00100000:0.0:1787882512.140829:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541910272 00000100:00100000:0.0:1787882512.140833:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541910272 00000100:00100000:0.0:1787882512.140853:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:0.0:1787882512.140862:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:0:x1874730541910144:12345-192.168.206.21@tcp:41: 00000004:00000024:0.0:1787882512.140931:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787882512.141034:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:0:x1874730541910144:12345-192.168.206.21@tcp:41: Request processed in 171us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882512.141042:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:0.0:1787882512.141061:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:0.0:1787882512.141068:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:5597:x1874730541910272:12345-192.168.206.21@tcp:41: 00000004:00000024:0.0:1787882512.141079:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787882512.141099:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:5597:x1874730541910272:12345-192.168.206.21@tcp:41: Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882512.141105:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00080000:1.0:1787882512.141171:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882512.154312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882512.154703:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541910400 00000100:00100000:3.0:1787882512.154713:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541910400 00000100:00100000:3.0:1787882512.154772:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:3.0:1787882512.154782:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:5597:x1874730541910400:12345-192.168.206.21@tcp:40: 00000100:00100000:3.0:1787882512.154979:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:5597:x1874730541910400:12345-192.168.206.21@tcp:40: Request processed in 197us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882512.154987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:1.0:1787882512.164345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882512.164400:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882512.164499:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541910784 00000100:00100000:2.0:1787882512.164518:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541910784 00000100:00100000:2.0:1787882512.164573:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:2.0:1787882512.164583:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:5597:x1874730541910784:12345-192.168.206.21@tcp:33: 00000100:00100000:3.0:1787882512.164767:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541910912 00000100:00100000:3.0:1787882512.164771:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541910912 00000100:00100000:3.0:1787882512.164811:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 126 00000100:00100000:3.0:1787882512.164818:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2359:x1874730541910912:12345-192.168.206.21@tcp:400: 00000100:00100000:3.0:1787882512.164905:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2359:x1874730541910912:12345-192.168.206.21@tcp:400: Request processed in 86us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882512.164912:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 126 00000100:00100000:1.0:1787882512.169315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882512.169360:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882512.169538:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541910528 00000100:00100000:0.0:1787882512.169549:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541910528 00000100:00100000:0.0:1787882512.169590:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541910656 00000100:00100000:0.0:1787882512.169593:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541910656 00000100:00100000:0.0:1787882512.169608:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1787882512.169617:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874730541910528:12345-192.168.206.21@tcp:8: 00010000:00080000:0.0:1787882512.169648:0:6710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:0.0:1787882512.169681:0:6710:0:(genops.c:1385:class_connect()) connect: client 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9, cookie 0xf4731e8a7c5ded81 00002000:00100000:0.0:1787882512.169693:0:6710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9/ffff9fa2c159c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787882512.169725:0:6710:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787882512.170240:0:6710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787882512.170271:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9fa2c159b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787882512.171587:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2355:x1874730541910528:12345-192.168.206.21@tcp:8: Request processed in 1959us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882512.171599:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1787882512.171635:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:0.0:1787882512.171641:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874730541910656:12345-192.168.206.21@tcp:8: 00010000:00080000:0.0:1787882512.171667:0:6710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:0.0:1787882512.171692:0:6710:0:(genops.c:1385:class_connect()) connect: client 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9, cookie 0xf4731e8a7c5ded88 00002000:00100000:0.0:1787882512.171702:0:6710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9/ffff9fa2c159e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787882512.171725:0:6710:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787882512.172083:0:6710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787882512.175267:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9fa2c159d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787882512.176216:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2355:x1874730541910656:12345-192.168.206.21@tcp:8: Request processed in 4562us (6844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882512.176229:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000004:00080000:2.0:1787882512.213259:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 48595us 00000004:00200000:2.0:1787882512.245187:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787882512.245583:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:5597:x1874730541910784:12345-192.168.206.21@tcp:33: Request processed in 80995us (81240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882512.245594:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00010000:00010000:0.0:1787882512.495238:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882512.577658:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882512.577755:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541911040 00000100:00100000:2.0:1787882512.577765:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541911040 00000100:00100000:2.0:1787882512.577828:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:2.0:1787882512.577839:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:5634:x1874730541911040:12345-192.168.206.21@tcp:101: 00010000:00010000:2.0:1787882512.577857:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882512.578057:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265a00/0xf4731e8a7c5ded8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842f4a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882512.578132:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5ded96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882512.578776:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5ded96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882512.578794:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5ded96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882512.579013:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787882512.579017:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882512.579093:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5ded96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882512.579127:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265a00/0xf4731e8a7c5ded8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f4a expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882512.579269:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5ded96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f4a expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882512.579278:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00f00) 00010000:00010000:2.0:1787882512.579341:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787882512.579346:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264800, rc 0) 00000100:00100000:2.0:1787882512.579554:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:5634:x1874730541911040:12345-192.168.206.21@tcp:101: Request processed in 1715us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882512.579562:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1787882512.682154:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563951616:0@lo:13: 00000100:00100000:0.0:1787882512.682242:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882512.682366:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563951616 00000100:00100000:2.0:1787882512.682374:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563951616 00000100:00100000:2.0:1787882512.682446:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787882512.682457:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563951616:12345-0@lo:13: 00002000:00000024:2.0:1787882512.682479:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882512.682947:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563951744:0@lo:400: 00000100:00100000:3.0:1787882512.682983:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882512.683038:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563951744 00000100:00100000:3.0:1787882512.683042:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563951744 00000100:00100000:3.0:1787882512.683070:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787882512.683077:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563951744:12345-0@lo:400: 00000100:00100000:3.0:1787882512.683113:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563951744:12345-0@lo:400: Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882512.683119:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1787882512.683148:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787882512.683170:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563951744:0@lo:400: 00000100:00100000:3.0:1787882512.691051:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563951872:0@lo:400: 00000100:00100000:3.0:1787882512.691123:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882512.691235:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563951872 00000100:00100000:0.0:1787882512.691243:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563951872 00000100:00100000:0.0:1787882512.691289:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787882512.691297:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563951872:12345-0@lo:400: 00000100:00100000:2.0:1787882512.691583:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563951616:12345-0@lo:13: Request processed in 9127us (9339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882512.691593:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787882512.691624:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563952000:0@lo:400: 00000100:00100000:2.0:1787882512.691652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882512.691680:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563952000 00000100:00100000:2.0:1787882512.691683:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563952000 00000100:00100000:2.0:1787882512.691709:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787882512.691714:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563952000:12345-0@lo:400: 00000100:00100000:2.0:1787882512.691756:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563952000:12345-0@lo:400: Request processed in 42us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882512.691771:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787882512.691814:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563952000:0@lo:400: 00000100:00080000:2.0:1787882512.691830:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787882512.691867:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1403480 x1874730563951616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882512.691906:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563951616:0@lo:13: 00000100:00100000:0.0:1787882512.692053:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563951872:12345-0@lo:400: Request processed in 754us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882512.692068:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787882512.692584:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563951872:0@lo:400: 00000100:00100000:2.0:1787882512.692690:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563952128:0@lo:400: 00000100:00100000:2.0:1787882512.692730:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882512.692759:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787882512.692764:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563952256:0@lo:400: 00000100:00100000:2.0:1787882512.692799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882512.692844:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563952256 00000100:00100000:1.0:1787882512.692850:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563952256 00000100:00100000:3.0:1787882512.692888:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563952128 00000100:00100000:3.0:1787882512.692892:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563952128 00000100:00100000:1.0:1787882512.692910:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787882512.692914:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787882512.692918:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563952256:12345-0@lo:400: 00000100:00100000:3.0:1787882512.692919:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563952128:12345-0@lo:400: 00000100:00100000:3.0:1787882512.692955:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563952128:12345-0@lo:400: Request processed in 35us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882512.692971:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787882512.693031:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787882512.693035:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787882512.693073:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563952256:12345-0@lo:400: Request processed in 156us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882512.693080:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787882512.693234:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c158ad80 x1874730563952256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882512.693245:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787882512.693257:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563952256:0@lo:400: 00000100:00100000:2.0:1787882512.693271:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563952128:0@lo:400: 00000100:00100000:0.0:1787882513.196621:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787882513.196645:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563952384:0@lo:13: 00000100:00100000:0.0:1787882513.196723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882513.197525:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563952384 00000100:00100000:3.0:1787882513.197534:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563952384 00000100:00100000:3.0:1787882513.197618:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787882513.197629:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563952384:12345-0@lo:13: 00002000:00000024:3.0:1787882513.197650:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882513.197713:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563952384:12345-0@lo:13: Request processed in 86us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882513.197721:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787882513.197783:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1401880 x1874730563952384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882513.197802:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563952384:0@lo:13: 00000001:00100000:3.0:1787882513.288015:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00010000:00010000:0.0:1787882513.514371:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882514.538100:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882514.960450:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882514.960771:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541911168 00000100:00100000:2.0:1787882514.960781:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541911168 00000100:00100000:2.0:1787882514.960948:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:2.0:1787882514.960961:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:5687:x1874730541911168:12345-192.168.206.21@tcp:41: 00000004:00000024:2.0:1787882514.961004:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787882514.961065:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:5687:x1874730541911168:12345-192.168.206.21@tcp:41: Request processed in 107us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882514.961080:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00080000:3.0:1787882514.961482:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882514.966593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882514.966734:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541911296 00000100:00100000:3.0:1787882514.966744:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541911296 00000100:00100000:3.0:1787882514.966815:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1787882514.966825:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:5687:x1874730541911296:12345-192.168.206.21@tcp:13: 00002000:00000024:3.0:1787882514.966861:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882514.966942:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:5687:x1874730541911296:12345-192.168.206.21@tcp:13: Request processed in 119us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882514.966950:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00080000:1.0:1787882514.967281:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787882514.974556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882514.975433:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541911424 00000100:00100000:3.0:1787882514.975446:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541911424 00000100:00100000:3.0:1787882514.975545:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:3.0:1787882514.975556:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:5687:x1874730541911424:12345-192.168.206.21@tcp:13: 00000100:00080000:1.0:1787882514.975668:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1787882514.975729:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882514.975799:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:5687:x1874730541911424:12345-192.168.206.21@tcp:13: Request processed in 244us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882514.975822:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00010000:00010000:3.0:1787882515.564165:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787882516.362524:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00010000:00010000:1.0:1787882516.586000:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787882516.860025:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00010000:00010000:0.0:1787882517.619430:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882517.665382:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882517.665425:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882517.665466:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882517.665477:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541911936 00000100:00100000:3.0:1787882517.665499:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882517.665499:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541911936 00000100:00100000:3.0:1787882517.665520:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541911808 00000100:00100000:3.0:1787882517.665524:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541911808 00000100:00100000:2.0:1787882517.665579:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541911680 00000100:00100000:2.0:1787882517.665583:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541911680 00000100:00100000:2.0:1787882517.665635:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:2.0:1787882517.665647:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541911680:12345-192.168.206.21@tcp:400: 00000100:00100000:2.0:1787882517.665731:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541911680:12345-192.168.206.21@tcp:400: Request processed in 86us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882517.665739:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:2.0:1787882517.665768:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541911552 00000100:00100000:2.0:1787882517.665771:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541911552 00000100:00100000:2.0:1787882517.665793:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:2.0:1787882517.665800:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa28660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2357:x1874730541911552:12345-192.168.206.21@tcp:400: 00000100:00100000:2.0:1787882517.665822:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa28660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2357:x1874730541911552:12345-192.168.206.21@tcp:400: Request processed in 23us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882517.665828:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:3.0:1787882517.666021:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:3.0:1787882517.666029:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541911808:12345-192.168.206.21@tcp:400: 00000100:00100000:3.0:1787882517.666069:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541911808:12345-192.168.206.21@tcp:400: Request processed in 42us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882517.666075:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:3.0:1787882517.666088:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:3.0:1787882517.666094:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541911936:12345-192.168.206.21@tcp:400: 00000100:00100000:3.0:1787882517.666112:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541911936:12345-192.168.206.21@tcp:400: Request processed in 19us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882517.666117:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00080000:2.0:1787882517.666925:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787882517.666932:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787882517.666934:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882517.802435:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563952896:0@lo:400: 00000100:00100000:1.0:1787882517.802435:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563952768:0@lo:400: 00000100:00100000:2.0:1787882517.802502:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563952512:0@lo:400: 00000100:00100000:1.0:1787882517.803431:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882517.803500:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787882517.803510:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563952640:0@lo:400: 00000100:00100000:1.0:1787882517.803538:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882517.803566:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563953152:0@lo:400: 00000100:00100000:1.0:1787882517.803592:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882517.803627:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563952768 00000100:00100000:1.0:1787882517.803634:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563952768 00000100:00100000:1.0:1787882517.803683:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563952640 00000100:00100000:1.0:1787882517.803687:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563952640 00000100:00100000:1.0:1787882517.803709:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787882517.803717:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563952768:12345-0@lo:400: 00000100:00100000:1.0:1787882517.803766:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563952768:12345-0@lo:400: Request processed in 50us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882517.803774:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787882517.803786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882517.803791:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787882517.803797:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563952640:12345-0@lo:400: 00000100:00100000:1.0:1787882517.803824:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563952640:12345-0@lo:400: Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882517.803829:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787882517.803848:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563953152 00000100:00100000:1.0:1787882517.803852:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563953152 00000100:00100000:1.0:1787882517.803888:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563952896 00000100:00100000:1.0:1787882517.803891:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563952896 00000100:00100000:1.0:1787882517.803906:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787882517.803910:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787882517.803912:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563953152:12345-0@lo:400: 00000100:00100000:3.0:1787882517.803917:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563952896:12345-0@lo:400: 00000100:00100000:1.0:1787882517.803941:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563953152:12345-0@lo:400: Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882517.803944:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563952896:12345-0@lo:400: Request processed in 29us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882517.803947:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787882517.803950:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787882517.803961:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787882517.803965:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882517.803968:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787882517.803996:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c158b480 x1874730563952896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882517.803996:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563952640:0@lo:400: 00010000:00080000:1.0:1787882517.804006:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1589880 x1874730563953152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882517.804007:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563952896:0@lo:400: 00000100:00100000:1.0:1787882517.804014:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563953152:0@lo:400: 00000100:00100000:1.0:1787882517.804021:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563952768:0@lo:400: 00000100:00100000:2.0:1787882517.812078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882517.812132:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563953024:0@lo:400: 00000100:00100000:2.0:1787882517.812167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882517.812222:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563952512 00000100:00100000:2.0:1787882517.812230:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563952512 00000100:00100000:2.0:1787882517.812273:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787882517.812295:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563952512:12345-0@lo:400: 00000100:00100000:2.0:1787882517.812350:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563952512:12345-0@lo:400: Request processed in 56us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882517.812358:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787882517.812395:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563953024 00000100:00100000:2.0:1787882517.812399:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563953024 00000100:00100000:2.0:1787882517.812434:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787882517.812440:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563953024:12345-0@lo:400: 00000100:00100000:2.0:1787882517.812471:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563953024:12345-0@lo:400: Request processed in 32us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882517.812489:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787882517.812510:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882517.812555:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563952512:0@lo:400: 00000100:00100000:2.0:1787882517.812568:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563953024:0@lo:400: 00000100:00100000:2.0:1787882517.812721:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563953280:0@lo:13: 00000100:00100000:2.0:1787882517.812753:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882517.819697:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563953280 00000100:00100000:1.0:1787882517.819714:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563953280 00000100:00100000:1.0:1787882517.819773:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787882517.819784:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563953280:12345-0@lo:13: 00002000:00000024:1.0:1787882517.819820:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882517.819911:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563953280:12345-0@lo:13: Request processed in 129us (7158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882517.819918:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787882517.819972:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c158bb80 x1874730563953280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882517.819991:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563953280:0@lo:13: 00000001:02000400:0.0:1787882517.973633:0:8313:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787882518.320456:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563953408:0@lo:13: 00000100:00100000:0.0:1787882518.320537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882518.322830:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563953408 00000100:00100000:3.0:1787882518.322856:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563953408 00000100:00100000:3.0:1787882518.322938:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787882518.322949:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563953408:12345-0@lo:13: 00002000:00000024:3.0:1787882518.322986:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882518.323061:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563953408:12345-0@lo:13: Request processed in 113us (2522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882518.323068:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787882518.323320:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1400700 x1874730563953408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882518.323341:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563953408:0@lo:13: 00010000:00010000:1.0:1787882518.635748:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882519.658037:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882520.696567:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882521.709609:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787882521.756474:0:8461:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe83b206b0 20000000:00000080:2.0:1787882521.756497:0:8461:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa2b616f800 uarg=0000000000000000 20000000:01000000:2.0:1787882521.756542:0:8461:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787882521.756544:0:8461:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787882521.756548:0:8461:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787882521.756553:0:8461:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787882521.756559:0:8461:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787882521.756576:0:8461:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787882521.756579:0:8461:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787882521.756796:0:8461:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787882521.756800:0:8461:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787882521.757693:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787882521.758379:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787882521.758449:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787882521.758492:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1787882521.758504:0:8461:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787882521.758507:0:8461:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787882521.759305:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787882521.759681:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787882521.759747:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787882521.759783:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787882521.759798:0:8461:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787882521.759801:0:8461:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787882521.761184:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787882521.761723:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787882521.761770:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787882521.761811:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787882521.761824:0:8461:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787882521.761826:0:8461:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787882521.767297:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787882521.768333:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787882521.768418:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787882521.768473:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1787882521.768493:0:8461:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787882521.768517:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768542:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dec93 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768564:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5decc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5decbd expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768571:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5decee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dece7 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768579:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5decfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5decf5 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768587:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5ded0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5ded03 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768594:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2c21c7e00/0xf4731e8a7c5ded26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5ded1f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768601:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5ded50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5ded49 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768612:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5ded5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ee8 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768620:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813ff000/0xf4731e8a7c5ded65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842eef expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768628:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768681:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813ff000/0xf4731e8a7c5ded65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842eef expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768713:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2813ff000/0xf4731e8a7c5ded65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842eef expref: 9 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.768732:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563953536:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882521.768900:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5ded5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ee8 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768909:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5ded5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ee8 expref: 9 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.768918:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563953664:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882521.768955:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5ded50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5ded49 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.768963:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5ded50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded49 expref: 18 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.768972:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563953792:0@lo:104: 00000100:00100000:0.0:1787882521.769019:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787882521.769072:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2c21c7e00/0xf4731e8a7c5ded26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5ded1f expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.769081:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2c21c7e00/0xf4731e8a7c5ded26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded1f expref: 18 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.769090:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563953920:0@lo:104: 00000100:00100000:0.0:1787882521.769114:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787882521.769157:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5ded0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5ded03 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.769166:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5ded0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded03 expref: 18 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.769173:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563954048:0@lo:104: 00010000:00010000:0.0:1787882521.769195:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5decfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5decf5 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.769201:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5decfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5decf5 expref: 18 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.769208:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563954176:0@lo:104: 00010000:00010000:0.0:1787882521.769243:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5decee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dece7 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.769250:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5decee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dece7 expref: 18 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.769257:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563954304:0@lo:104: 00010000:00010000:0.0:1787882521.769279:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5decc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5decbd expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.769285:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5decc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5decbd expref: 18 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.769292:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563954432:0@lo:104: 00010000:00010000:0.0:1787882521.769311:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dec93 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.769329:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec93 expref: 18 pid: 5835 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.769337:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563954560:0@lo:104: 00000100:00100000:0.0:1787882521.769358:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787882521.769540:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787882521.769562:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882521.769576:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882521.769586:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882521.769595:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882521.769602:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882521.769615:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563953792 00000100:00100000:1.0:1787882521.769624:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563953792 00000100:00100000:1.0:1787882521.769676:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563953920 00000100:00100000:1.0:1787882521.769680:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563953920 00000100:00100000:1.0:1787882521.769692:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563954048 00000100:00100000:1.0:1787882521.769695:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563954048 00000100:00100000:1.0:1787882521.769703:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563954176 00000100:00100000:1.0:1787882521.769705:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563954176 00000100:00100000:1.0:1787882521.769713:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563954304 00000100:00100000:1.0:1787882521.769716:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563954304 00000100:00100000:1.0:1787882521.769725:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563954432 00000100:00100000:1.0:1787882521.769727:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563954432 00000100:00100000:1.0:1787882521.769734:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563954560 00000100:00100000:1.0:1787882521.769736:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563954560 00000100:00100000:1.0:1787882521.769748:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787882521.769759:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:8461:x1874730563953792:12345-0@lo:104: 00010000:00010000:1.0:1787882521.769773:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.769845:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787882521.769851:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af848e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+9:8461:x1874730563953792:12345-0@lo:104: Request processed in 93us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882521.769858:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787882521.769900:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787882521.769907:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1570450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+8:8461:x1874730563953920:12345-0@lo:104: 00010000:00010000:1.0:1787882521.769915:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.769946:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787882521.769951:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1570450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+8:8461:x1874730563953920:12345-0@lo:104: Request processed in 45us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882521.769956:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787882521.769992:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787882521.769997:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+7:8461:x1874730563954048:12345-0@lo:104: 00010000:00010000:1.0:1787882521.770004:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770025:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787882521.770029:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+7:8461:x1874730563954048:12345-0@lo:104: Request processed in 33us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882521.770034:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787882521.770043:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787882521.770047:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+6:8461:x1874730563954176:12345-0@lo:104: 00010000:00010000:1.0:1787882521.770053:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770072:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787882521.770076:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+6:8461:x1874730563954176:12345-0@lo:104: Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882521.770082:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787882521.770091:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787882521.770096:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+5:8461:x1874730563954304:12345-0@lo:104: 00010000:00010000:1.0:1787882521.770102:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770124:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787882521.770129:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+5:8461:x1874730563954304:12345-0@lo:104: Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882521.770134:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787882521.770153:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787882521.770159:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1588a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:8461:x1874730563954432:12345-0@lo:104: 00010000:00010000:1.0:1787882521.770167:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770195:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787882521.770200:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1588a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:8461:x1874730563954432:12345-0@lo:104: Request processed in 42us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882521.770206:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787882521.770217:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787882521.770223:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:8461:x1874730563954560:12345-0@lo:104: 00010000:00010000:1.0:1787882521.770229:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770316:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787882521.770321:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:8461:x1874730563954560:12345-0@lo:104: Request processed in 98us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882521.770327:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787882521.770347:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787882521.770353:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770361:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280030600 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882521.770365:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770375:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882521.770394:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882521.770400:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882521.770436:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770441:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882521.770474:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770482:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280030600/0xf4731e8a7c5ded49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5ded50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770497:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787882521.770500:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770505:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882521.770507:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770513:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882521.770519:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882521.770524:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882521.770541:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770547:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882521.770562:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770569:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce000/0xf4731e8a7c5ded1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5ded26 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770577:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787882521.770580:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770585:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cea00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882521.770588:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770594:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882521.770599:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882521.770605:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882521.770616:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770622:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882521.770628:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770646:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cea00/0xf4731e8a7c5ded03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5ded0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770654:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787882521.770657:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770662:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2c21c6a00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882521.770665:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770671:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882521.770677:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882521.770681:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882521.770694:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770699:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882521.770703:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770709:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5decf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770718:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787882521.770726:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770732:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882521.770734:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770740:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882521.770747:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882521.770752:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882521.770765:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770771:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882521.770774:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770780:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce800/0xf4731e8a7c5dece7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decee expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770789:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787882521.770792:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770798:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813ffe00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882521.770800:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770816:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882521.770823:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882521.770829:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882521.770844:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770849:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882521.770853:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770860:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffe00/0xf4731e8a7c5decbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decc4 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770895:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882521.770898:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770903:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813ffc00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882521.770906:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770912:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882521.770917:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882521.770927:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882521.770940:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770945:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882521.770949:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770954:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffc00/0xf4731e8a7c5dec93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dec9a expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.770966:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882521.770968:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882521.770969:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882521.770979:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882521.771003:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563954688:0@lo:103: 00000100:00100000:1.0:1787882521.771052:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882521.771080:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563955200:0@lo:103: 00000100:00100000:1.0:1787882521.771099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882521.771117:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787882521.771122:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563955072:0@lo:103: 00000100:00100000:1.0:1787882521.771140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882521.771168:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563954816:0@lo:103: 00000100:00100000:1.0:1787882521.771190:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882521.771200:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563955328:0@lo:103: 00000100:00100000:1.0:1787882521.771215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882521.771738:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563953792:0@lo:104: 00000100:00100000:0.0:1787882521.771748:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563953920:0@lo:104: 00000100:00100000:0.0:1787882521.771754:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563954048:0@lo:104: 00000100:00100000:0.0:1787882521.771760:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563954176:0@lo:104: 00000100:00100000:0.0:1787882521.771767:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563954304:0@lo:104: 00000100:00100000:0.0:1787882521.771774:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563954432:0@lo:104: 00000100:00100000:0.0:1787882521.771779:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563954560:0@lo:104: 00000100:00100000:0.0:1787882521.772626:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563954688 00000100:00100000:0.0:1787882521.772636:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563954688 00010000:00010000:0.0:1787882521.772676:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5ded50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded49 expref: 19 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.772702:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563955200 00000100:00100000:0.0:1787882521.772704:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563955200 00010000:00010000:0.0:1787882521.772717:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5decee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dece7 expref: 20 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.772727:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563955072 00000100:00100000:0.0:1787882521.772730:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563955072 00010000:00010000:0.0:1787882521.772740:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5decfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5decf5 expref: 21 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.772768:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563954816 00000100:00100000:0.0:1787882521.772772:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563954816 00010000:00010000:0.0:1787882521.772785:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2c21c7e00/0xf4731e8a7c5ded26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded1f expref: 22 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.772796:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563955328 00000100:00100000:0.0:1787882521.772798:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563955328 00010000:00010000:0.0:1787882521.772812:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5decc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5decbd expref: 23 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882521.772824:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787882521.772832:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+23:3306:x1874730563954688:12345-0@lo:103: 00010000:00010000:0.0:1787882521.772846:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882521.772852:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5ded50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded49 expref: 23 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.772862:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5ded50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded49 expref: 23 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.772906:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5ded50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5ded49 expref: 23 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.772924:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882521.772989:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+22:3306:x1874730563954688:12345-0@lo:103: Request processed in 159us (1938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882521.772996:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787882521.773016:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787882521.773020:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+21:3306:x1874730563955200:12345-0@lo:103: 00010000:00010000:0.0:1787882521.773036:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882521.773040:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5decee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dece7 expref: 21 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.773048:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5decee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dece7 expref: 21 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.773056:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5decee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dece7 expref: 21 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.773064:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882521.773088:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+20:3306:x1874730563955200:12345-0@lo:103: Request processed in 67us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882521.773094:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787882521.773106:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787882521.773111:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563955072:12345-0@lo:103: 00010000:00010000:0.0:1787882521.773117:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882521.773122:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5decfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5decf5 expref: 19 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.773130:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5decfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5decf5 expref: 19 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.773140:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5decfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5decf5 expref: 19 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.773148:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882521.773170:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:3306:x1874730563955072:12345-0@lo:103: Request processed in 58us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882521.773185:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787882521.773198:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787882521.773203:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:3307:x1874730563954816:12345-0@lo:103: 00010000:00010000:0.0:1787882521.773211:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882521.773215:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2c21c7e00/0xf4731e8a7c5ded26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded1f expref: 17 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.773224:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2c21c7e00/0xf4731e8a7c5ded26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded1f expref: 17 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882521.773397:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787882521.773411:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563954944:0@lo:103: 00000100:00100000:1.0:1787882521.773467:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882521.773501:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563955456:0@lo:103: 00000100:00100000:1.0:1787882521.773530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882521.773555:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787882521.773563:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787882521.773583:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787882521.773589:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563954944 00000100:00100000:1.0:1787882521.773592:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563954944 00010000:00010000:1.0:1787882521.773606:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5ded0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded03 expref: 18 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882521.773618:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787882521.773622:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563955456 00000100:00100000:1.0:1787882521.773624:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563955456 00010000:00010000:1.0:1787882521.773631:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec93 expref: 19 pid: 5835 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882521.773639:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787882521.773643:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787882521.773647:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563955328:12345-0@lo:103: 00010000:00010000:1.0:1787882521.773655:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882521.773659:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5decc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5decbd expref: 19 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882521.773975:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563955072:0@lo:103: 00000100:00100000:2.0:1787882521.773987:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563954688:0@lo:103: 00000100:00100000:2.0:1787882521.773994:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563955200:0@lo:103: 00010000:00010000:0.0:1787882521.774126:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2c21c7e00/0xf4731e8a7c5ded26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5ded1f expref: 19 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.774157:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5decc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5decbd expref: 18 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.774170:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5decc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5decbd expref: 18 pid: 5837 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.774198:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882521.774250:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:3307:x1874730563955328:12345-0@lo:103: Request processed in 601us (3032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882521.774257:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787882521.774274:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787882521.774281:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787882521.774288:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3307:x1874730563954944:12345-0@lo:103: 00010000:00010000:1.0:1787882521.774296:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882521.774301:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5ded0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded03 expref: 16 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.774310:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5ded0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5ded03 expref: 16 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.774319:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5ded0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5ded03 expref: 16 pid: 5838 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.774328:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882521.774351:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:3307:x1874730563954944:12345-0@lo:103: Request processed in 64us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882521.774357:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787882521.774368:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787882521.774374:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787882521.774380:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286603450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:3307:x1874730563955456:12345-0@lo:103: 00010000:00010000:1.0:1787882521.774388:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882521.774393:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec93 expref: 14 pid: 5835 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.774412:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dec93 expref: 14 pid: 5835 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.774421:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2c21c6000/0xf4731e8a7c5dec9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dec93 expref: 14 pid: 5835 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.774431:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882521.774452:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286603450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:3307:x1874730563955456:12345-0@lo:103: Request processed in 72us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882521.774469:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787882521.774648:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563954944:0@lo:103: 00000100:00100000:3.0:1787882521.774657:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563955456:0@lo:103: 00000100:00100000:3.0:1787882521.774665:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563955328:0@lo:103: 00010000:00010000:0.0:1787882521.775250:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882521.775304:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3307:x1874730563954816:12345-0@lo:103: Request processed in 2099us (4111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882521.775312:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787882521.775606:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563954816:0@lo:103: 00000100:00100000:0.0:1787882521.777643:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563953536:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882521.777657:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8461:1874730563953664:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882521.777720:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882521.781952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882521.782084:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541912064 00000100:00100000:1.0:1787882521.782096:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541912064 00010000:00010000:1.0:1787882521.782158:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813ff000/0xf4731e8a7c5ded65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842eef expref: 10 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882521.782214:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:1.0:1787882521.782226:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2356:x1874730541912064:12345-192.168.206.21@tcp:103: 00010000:00010000:1.0:1787882521.782956:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882521.782967:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813ff000/0xf4731e8a7c5ded65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842eef expref: 10 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.782983:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813ff000/0xf4731e8a7c5ded65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842eef expref: 10 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.783004:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813ff000/0xf4731e8a7c5ded65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842eef expref: 10 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882521.783022:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882521.783109:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:2356:x1874730541912064:12345-192.168.206.21@tcp:103: Request processed in 884us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882521.783117:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:2.0:1787882521.785579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882521.785724:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541912192 00000100:00100000:3.0:1787882521.785738:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541912192 00010000:00010000:3.0:1787882521.785793:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5ded5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ee8 expref: 9 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882521.785888:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:3.0:1787882521.785902:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:2357:x1874730541912192:12345-192.168.206.21@tcp:103: 00010000:00010000:3.0:1787882521.785920:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882521.785927:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5ded5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ee8 expref: 9 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.785954:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5ded5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ee8 expref: 9 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.785975:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5ded5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ee8 expref: 9 pid: 5837 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.785999:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.786008:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.786029:0:8466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.786038:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.786045:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.786052:0:8466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.786071:0:8466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280030c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882521.786076:0:8466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.786086:0:8466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.786109:0:8466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.786208:0:8461:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882521.786219:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.786471:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5ded9d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882521.786494:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882521.786572:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:2357:x1874730541912192:12345-192.168.206.21@tcp:103: Request processed in 672us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882521.786580:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00010000:00010000:1.0:1787882522.730113:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882522.785217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882522.785441:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541912320 00000100:00100000:2.0:1787882522.785462:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541912320 00000100:00100000:2.0:1787882522.785535:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:2.0:1787882522.785555:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:2356:x1874730541912320:12345-192.168.206.21@tcp:400: 00000100:00100000:2.0:1787882522.785765:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:2356:x1874730541912320:12345-192.168.206.21@tcp:400: Request processed in 212us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882522.785774:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:2.0:1787882522.788709:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882522.789830:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541912448 00000100:00100000:1.0:1787882522.789848:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541912448 00000100:00100000:1.0:1787882522.789997:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:3.0:1787882522.790000:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882522.790015:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541912448:12345-192.168.206.21@tcp:400: 00000100:00100000:1.0:1787882522.790124:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541912448:12345-192.168.206.21@tcp:400: Request processed in 116us (2322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882522.790132:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:1.0:1787882522.790158:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541912704 00000100:00100000:1.0:1787882522.790162:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541912704 00000100:00100000:1.0:1787882522.790193:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:1.0:1787882522.790200:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541912704:12345-192.168.206.21@tcp:400: 00000100:00100000:1.0:1787882522.790233:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541912704:12345-192.168.206.21@tcp:400: Request processed in 34us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882522.790241:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00080000:2.0:1787882522.790550:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882522.790557:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:2.0:1787882522.790558:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882522.795008:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541912576 00000100:00100000:0.0:1787882522.795029:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541912576 00000100:00100000:0.0:1787882522.795226:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:0.0:1787882522.795242:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541912576:12345-192.168.206.21@tcp:400: 00000100:00100000:0.0:1787882522.795371:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541912576:12345-192.168.206.21@tcp:400: Request processed in 134us (4816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882522.795379:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00080000:2.0:1787882522.802723:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882522.928479:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563955584:0@lo:13: 00000100:00100000:0.0:1787882522.928586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882522.932960:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563955968:0@lo:400: 00000100:00100000:0.0:1787882522.933062:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882522.933123:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787882522.933129:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563955840:0@lo:400: 00000100:00100000:0.0:1787882522.933154:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882522.933199:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563956096:0@lo:400: 00000100:00100000:0.0:1787882522.933227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882522.933260:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787882522.933266:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563955712:0@lo:400: 00000100:00100000:0.0:1787882522.933301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882522.933321:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563956224:0@lo:400: 00000100:00100000:0.0:1787882522.933346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882522.933446:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563955584 00000100:00100000:1.0:1787882522.933474:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563955584 00000100:00100000:1.0:1787882522.933548:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787882522.933559:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563955584:12345-0@lo:13: 00002000:00000024:1.0:1787882522.933605:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882522.933675:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563955584:12345-0@lo:13: Request processed in 117us (5088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882522.933684:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787882522.933711:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563956224 00000100:00100000:1.0:1787882522.933733:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563956224 00000100:00100000:1.0:1787882522.933768:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787882522.933775:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563956224:12345-0@lo:400: 00000100:00100000:1.0:1787882522.933816:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563956224:12345-0@lo:400: Request processed in 41us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882522.933822:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787882522.933842:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563955968 00000100:00100000:1.0:1787882522.933846:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563955968 00000100:00100000:1.0:1787882522.933904:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563955840 00000100:00100000:1.0:1787882522.933907:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563955840 00000100:00100000:1.0:1787882522.933921:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563956096 00000100:00100000:1.0:1787882522.933923:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563956096 00000100:00100000:1.0:1787882522.933937:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787882522.933942:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563955968:12345-0@lo:400: 00000100:00100000:1.0:1787882522.933978:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563955968:12345-0@lo:400: Request processed in 34us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882522.933984:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787882522.933996:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787882522.934002:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563955840:12345-0@lo:400: 00000100:00100000:1.0:1787882522.934028:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563955840:12345-0@lo:400: Request processed in 27us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882522.934034:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787882522.934048:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787882522.934055:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563956096:12345-0@lo:400: 00000100:00100000:1.0:1787882522.934082:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563956096:12345-0@lo:400: Request processed in 28us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882522.934088:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787882522.934135:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b9876d80 x1874730563956224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882522.934159:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563956224:0@lo:400: 00000100:00100000:1.0:1787882522.934175:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563956096:0@lo:400: 00010000:00080000:1.0:1787882522.934188:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af848e00 x1874730563955584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882522.934206:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563955584:0@lo:13: 00000100:00080000:0.0:1787882522.934339:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787882522.934345:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787882522.934347:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882522.934368:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563955840:0@lo:400: 00000100:00100000:0.0:1787882522.934395:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563955968:0@lo:400: 00000100:00100000:2.0:1787882522.934503:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563955712 00000100:00100000:2.0:1787882522.934510:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563955712 00000100:00100000:2.0:1787882522.934560:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787882522.934568:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa28660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3305:x1874730563955712:12345-0@lo:400: 00000100:00100000:2.0:1787882522.934620:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa28660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:3305:x1874730563955712:12345-0@lo:400: Request processed in 54us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882522.934627:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787882522.934673:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563955712:0@lo:400: 00000100:00100000:0.0:1787882523.434438:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563956352:0@lo:13: 00000100:00100000:0.0:1787882523.434552:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882523.436146:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563956352 00000100:00100000:3.0:1787882523.436164:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563956352 00000100:00100000:3.0:1787882523.436260:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787882523.436274:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563956352:12345-0@lo:13: 00002000:00000024:3.0:1787882523.436324:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882523.436632:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563956352:12345-0@lo:13: Request processed in 361us (2080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.436641:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787882523.437018:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1401180 x1874730563956352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882523.437044:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563956352:0@lo:13: 10000000:01000000:2.0:1787882523.755480:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787882523.755490:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa2c174b000 from 39 10000000:01000000:2.0:1787882523.755497:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787882523.755520:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882523.755563:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882523.755577:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882523.755590:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882523.755622:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563956480:0@lo:101: 00000100:00100000:2.0:1787882523.755723:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882523.755825:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a9891000 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.756066:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563956480 00000100:00100000:3.0:1787882523.756075:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563956480 00000100:00100000:3.0:1787882523.756142:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787882523.756153:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+12:5841:x1874730563956480:12345-0@lo:101: 00010000:00010000:3.0:1787882523.756169:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882523.756186:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b67cec00/0xf4731e8a7c5dedab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5deda4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.756225:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67cec00/0xf4731e8a7c5dedab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5deda4 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.756238:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b67cec00/0xf4731e8a7c5dedab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deda4 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.756250:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cec00, rc 0) 00000100:00100000:3.0:1787882523.756317:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563956480:12345-0@lo:101: Request processed in 157us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.756325:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787882523.756508:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563956480:0@lo:101: 00010000:00010000:1.0:1787882523.756530:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.756542:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882523.756624:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563956608:0@lo:501: 00000100:00100000:1.0:1787882523.756664:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.756706:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157600 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.756789:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563956608 00000100:00100000:0.0:1787882523.756795:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563956608 00000100:00100000:0.0:1787882523.756832:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787882523.756841:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563956608:12345-0@lo:501: 00000100:00100000:0.0:1787882523.757232:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563956608:12345-0@lo:501: Request processed in 391us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.757241:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787882523.757399:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563956608:0@lo:501: 00000100:00100000:1.0:1787882523.757437:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563956736:0@lo:503: 00000100:00100000:1.0:1787882523.757496:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.757529:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157600 going to sleep for 11 seconds 00000100:00100000:2.0:1787882523.757556:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563956736 00000100:00100000:2.0:1787882523.757562:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563956736 00000100:00100000:2.0:1787882523.757588:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787882523.757597:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563956736:12345-0@lo:503: 00000100:00100000:2.0:1787882523.759626:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563956736:12345-0@lo:503: Request processed in 2015us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882523.759644:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787882523.759950:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563956736:0@lo:503: 00000100:00100000:1.0:1787882523.766634:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8479:1874730563956864:0@lo:502: 00000100:00100000:1.0:1787882523.766832:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.766952:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.767089:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563956864 00000100:00100000:0.0:1787882523.767099:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563956864 00000100:00100000:0.0:1787882523.767167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787882523.767181:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:8479:x1874730563956864:12345-0@lo:502: 00000100:00100000:0.0:1787882523.767583:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:8479:x1874730563956864:12345-0@lo:502: Request processed in 403us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.767593:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787882523.767998:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8479:1874730563956864:0@lo:502: 00000100:00100000:2.0:1787882523.768101:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8479:1874730563956992:0@lo:502: 00000100:00100000:2.0:1787882523.768155:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882523.768208:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a9891540 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.768373:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563956992 00000100:00100000:3.0:1787882523.768379:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563956992 00000100:00100000:3.0:1787882523.768429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787882523.768440:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:8479:x1874730563956992:12345-0@lo:502: 00000100:00100000:3.0:1787882523.768677:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:8479:x1874730563956992:12345-0@lo:502: Request processed in 238us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.768683:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787882523.773064:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8479:1874730563956992:0@lo:502: 00000040:00080000:2.0:1787882523.773148:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787882523.773566:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787882523.773594:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787882523.773607:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.773621:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882523.773634:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787882523.773637:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787882523.773640:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787882523.773691:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.773700:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.773711:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882523.773733:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563957120:0@lo:101: 00000100:00100000:1.0:1787882523.773822:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.773913:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157900 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.774104:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563957120 00000100:00100000:3.0:1787882523.774112:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563957120 00000100:00100000:3.0:1787882523.774167:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787882523.774178:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+13:5841:x1874730563957120:12345-0@lo:101: 00010000:00010000:3.0:1787882523.774216:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882523.774231:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b67cf200/0xf4731e8a7c5dedb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dedb2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.774259:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67cf200/0xf4731e8a7c5dedb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dedb2 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.774271:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b67cf200/0xf4731e8a7c5dedb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dedb2 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.774281:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cf200, rc 0) 00000100:00100000:3.0:1787882523.774332:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563957120:12345-0@lo:101: Request processed in 156us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.774340:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787882523.774920:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563957120:0@lo:101: 00010000:00010000:1.0:1787882523.774941:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.774953:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882523.776146:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563957248:0@lo:501: 00000100:00100000:1.0:1787882523.776361:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.776412:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157900 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.776589:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563957248 00000100:00100000:0.0:1787882523.776601:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563957248 00000100:00100000:0.0:1787882523.776675:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787882523.776687:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563957248:12345-0@lo:501: 00000100:00100000:0.0:1787882523.777465:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563957248:12345-0@lo:501: Request processed in 763us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.777487:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787882523.779416:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563957248:0@lo:501: 00000100:00100000:1.0:1787882523.779537:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563957376:0@lo:503: 00000100:00100000:1.0:1787882523.779636:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.779691:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157900 going to sleep for 11 seconds 00000100:00100000:2.0:1787882523.780133:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563957376 00000100:00100000:2.0:1787882523.780142:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563957376 00000100:00100000:2.0:1787882523.780216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787882523.780228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563957376:12345-0@lo:503: 00000100:00100000:2.0:1787882523.780528:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563957376:12345-0@lo:503: Request processed in 302us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882523.780537:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787882523.781317:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563957376:0@lo:503: 00000100:00100000:3.0:1787882523.782928:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8480:1874730563957504:0@lo:502: 00000100:00100000:3.0:1787882523.783049:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882523.783288:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287a26000 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.783468:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563957504 00000100:00100000:0.0:1787882523.783477:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563957504 00000100:00100000:0.0:1787882523.783530:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787882523.783541:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:8480:x1874730563957504:12345-0@lo:502: 00000100:00100000:0.0:1787882523.783829:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:8480:x1874730563957504:12345-0@lo:502: Request processed in 287us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.783838:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787882523.787275:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8480:1874730563957504:0@lo:502: 00000020:01000000:3.0:1787882523.787362:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882523.787380:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882523.787383:0:8480:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787882523.787394:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787882523.787462:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8480:1874730563957632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787882523.787567:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882523.787640:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287a26000 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.789946:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563957632 00000100:00100000:0.0:1787882523.789969:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563957632 00000100:00100000:0.0:1787882523.790084:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787882523.790098:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:8480:x1874730563957632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787882523.790502:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:8480:x1874730563957632:12345-0@lo:502:llog_process_th.0 Request processed in 405us (2934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.790511:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787882523.791482:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8480:1874730563957632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787882523.791554:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882523.791581:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882523.791584:0:8480:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787882523.791590:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787882523.791936:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787882523.791970:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787882523.791995:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.792009:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882523.792021:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787882523.792024:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa29d82f000 from 39 10000000:01000000:1.0:1787882523.792027:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787882523.792067:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.792087:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.792099:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882523.792133:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563957760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787882523.792215:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.792270:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157900 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.792604:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563957760 00000100:00100000:3.0:1787882523.792613:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563957760 00000100:00100000:3.0:1787882523.792674:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787882523.792687:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+14:5841:x1874730563957760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882523.792707:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882523.792726:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b67cf600/0xf4731e8a7c5dedc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dedc0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.792760:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67cf600/0xf4731e8a7c5dedc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dedc0 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.792772:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b67cf600/0xf4731e8a7c5dedc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dedc0 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.792782:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cf600, rc 0) 00000100:00100000:3.0:1787882523.793040:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563957760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 353us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.793047:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787882523.793218:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563957760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882523.793246:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.793258:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882523.793472:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563957888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882523.793509:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.793549:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157900 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.793926:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563957888 00000100:00100000:0.0:1787882523.793934:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563957888 00000100:00100000:0.0:1787882523.793987:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787882523.793997:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563957888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882523.794396:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563957888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 399us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.794405:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787882523.794767:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563957888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882523.794821:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563958016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882523.794903:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.794938:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157900 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.794979:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563958016 00000100:00100000:3.0:1787882523.794986:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563958016 00000100:00100000:3.0:1787882523.795030:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787882523.795038:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563958016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.795301:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563958016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 263us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.795752:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787882523.798338:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563958016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.807120:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8481:1874730563958144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787882523.807414:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882523.807487:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287a26b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.807510:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563958144 00000100:00100000:0.0:1787882523.807520:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563958144 00000100:00100000:0.0:1787882523.807584:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787882523.807597:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:8481:x1874730563958144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787882523.807970:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:8481:x1874730563958144:12345-0@lo:502:llog_process_th.0 Request processed in 374us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882523.808116:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8481:1874730563958144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882523.808212:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8481:1874730563958272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882523.808260:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.808297:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157900 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.808329:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563958272 00000100:00100000:3.0:1787882523.808334:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563958272 00000100:00100000:3.0:1787882523.808372:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787882523.808381:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:8481:x1874730563958272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787882523.808469:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787882523.808565:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:8481:x1874730563958272:12345-0@lo:502:llog_process_th.0 Request processed in 184us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.808572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787882523.808609:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8481:1874730563958272:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787882523.808637:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787882523.812977:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787882523.813054:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787882523.813070:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.813085:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882523.813099:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787882523.813102:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1787882523.813106:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787882523.813163:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.813172:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882523.813186:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882523.813223:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563958400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787882523.813561:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.813618:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b71573c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.813724:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563958400 00000100:00100000:0.0:1787882523.813735:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563958400 00000100:00100000:0.0:1787882523.813805:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787882523.813816:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:5841:x1874730563958400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882523.813833:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882523.813850:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dedd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dedce expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882523.813904:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dedd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dedce expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882523.813918:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dedd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dedce expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882523.813929:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031800, rc 0) 00000100:00100000:0.0:1787882523.814156:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563958400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 340us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.814165:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787882523.814368:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563958400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787882523.814390:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882523.814401:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882523.814498:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563958528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882523.814539:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882523.814665:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.818421:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563958528 00000100:00100000:3.0:1787882523.818459:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563958528 00000100:00100000:3.0:1787882523.818553:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787882523.818568:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563958528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.821567:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563958528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2990us (7013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.821586:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787882523.821807:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563958528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882523.821913:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563958656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882523.821989:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.822035:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157180 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.823493:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563958656 00000100:00100000:3.0:1787882523.823509:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563958656 00000100:00100000:3.0:1787882523.823582:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787882523.823595:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563958656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.823912:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563958656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 318us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.823920:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787882523.824457:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563958656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.825377:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8482:1874730563958784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787882523.825483:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882523.825541:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b634c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787882523.825610:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563958784 00000100:00100000:1.0:1787882523.825624:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563958784 00000100:00100000:1.0:1787882523.825703:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787882523.825712:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:8482:x1874730563958784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882523.826353:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:8482:x1874730563958784:12345-0@lo:502:llog_process_th.0 Request processed in 640us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882523.826362:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787882523.826461:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8482:1874730563958784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787882523.826512:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882523.826526:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882523.826528:0:8482:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787882523.826534:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787882523.826566:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8482:1874730563958912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787882523.826608:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882523.826682:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28c537b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.826717:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563958912 00000100:00100000:0.0:1787882523.826724:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563958912 00000100:00100000:0.0:1787882523.826795:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787882523.826805:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:8482:x1874730563958912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787882523.827042:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:8482:x1874730563958912:12345-0@lo:502:llog_process_th.0 Request processed in 239us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.827050:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787882523.827277:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8482:1874730563958912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787882523.827306:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882523.827313:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882523.827316:0:8482:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787882523.827321:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787882523.827605:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787882523.827630:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787882523.827644:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882523.827664:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882523.827676:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787882523.827679:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa285a97800 from 39 10000000:01000000:2.0:1787882523.827682:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787882523.827718:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882523.827725:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882523.827734:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882523.827751:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787882523.827796:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882523.828030:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.828329:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563959040 00000100:00100000:3.0:1787882523.828336:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563959040 00000100:00100000:3.0:1787882523.828378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787882523.828387:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563959040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882523.828399:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882523.828415:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b67ce200/0xf4731e8a7c5dede3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5deddc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.828441:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67ce200/0xf4731e8a7c5dede3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5deddc expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.828461:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b67ce200/0xf4731e8a7c5dede3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deddc expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.828472:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67ce200, rc 0) 00000100:00100000:3.0:1787882523.828516:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563959040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.828523:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787882523.828630:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787882523.828648:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882523.828657:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882523.828721:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882523.828749:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882523.828787:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.828840:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563959168 00000100:00100000:3.0:1787882523.828845:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563959168 00000100:00100000:3.0:1787882523.828863:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787882523.828905:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563959168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.829408:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563959168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 503us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.829415:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787882523.829512:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882523.829549:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882523.829594:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882523.829631:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.829687:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563959296 00000100:00100000:0.0:1787882523.829692:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563959296 00000100:00100000:0.0:1787882523.829729:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787882523.829736:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563959296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787882523.830137:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563959296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 401us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.830144:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787882523.830391:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882523.830757:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8483:1874730563959424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882523.830807:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.830844:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b71576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.830904:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563959424 00000100:00100000:3.0:1787882523.830910:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563959424 00000100:00100000:3.0:1787882523.830945:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787882523.830954:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:8483:x1874730563959424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787882523.831372:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:8483:x1874730563959424:12345-0@lo:502:llog_process_th.0 Request processed in 417us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.831380:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787882523.831504:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8483:1874730563959424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882523.831560:0:8483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8483:1874730563959552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882523.831594:0:8483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.831613:0:8483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b71576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.831661:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563959552 00000100:00100000:3.0:1787882523.831666:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563959552 00000100:00100000:3.0:1787882523.831694:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787882523.831701:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:8483:x1874730563959552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787882523.831835:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:8483:x1874730563959552:12345-0@lo:502:llog_process_th.0 Request processed in 134us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.831842:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787882523.831955:0:8483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8483:1874730563959552:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787882523.831988:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787882523.832310:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787882523.832337:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787882523.832349:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.832361:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882523.832387:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787882523.832390:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787882523.832393:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787882523.832426:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.832435:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.832445:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882523.832474:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.832510:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882523.832545:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf715c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.832626:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563959680 00000100:00100000:0.0:1787882523.832632:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563959680 00000100:00100000:0.0:1787882523.832662:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787882523.832670:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563959680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882523.832681:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882523.832696:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5dedf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dedea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882523.832724:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5dedf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dedea expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882523.832736:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5dedf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dedea expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882523.832747:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030200, rc 0) 00000100:00100000:0.0:1787882523.832782:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563959680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.832798:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787882523.832909:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882523.832924:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.832934:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882523.832998:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.833024:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882523.833038:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf715c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.833212:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563959808 00000100:00100000:0.0:1787882523.833216:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563959808 00000100:00100000:0.0:1787882523.833238:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787882523.833244:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563959808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882523.833546:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563959808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.833553:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787882523.833776:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.833811:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.833863:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882523.833925:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf715c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.834068:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563959936 00000100:00100000:0.0:1787882523.834140:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563959936 00000100:00100000:0.0:1787882523.834174:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787882523.834181:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563959936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787882523.834496:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563959936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 314us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.834503:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787882523.834631:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563959936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882523.835348:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8484:1874730563960064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882523.835410:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882523.835492:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157540 going to sleep for 11 seconds 00000100:00100000:3.0:1787882523.835524:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563960064 00000100:00100000:3.0:1787882523.835530:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563960064 00000100:00100000:3.0:1787882523.835591:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787882523.835600:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8484:x1874730563960064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787882523.835826:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8484:x1874730563960064:12345-0@lo:502:llog_process_th.0 Request processed in 226us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882523.835834:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787882523.835955:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8484:1874730563960064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787882523.836003:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787882523.836013:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882523.836016:0:8484:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787882523.836022:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787882523.836044:0:8484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8484:1874730563960192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787882523.836092:0:8484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882523.838636:0:8484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b717f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787882523.838710:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563960192 00000100:00100000:1.0:1787882523.838721:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563960192 00000100:00100000:1.0:1787882523.838799:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787882523.838809:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8484:x1874730563960192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882523.839636:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8484:x1874730563960192:12345-0@lo:502:llog_process_th.0 Request processed in 822us (3537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882523.839647:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787882523.839845:0:8484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8484:1874730563960192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787882523.839915:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787882523.839933:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882523.839936:0:8484:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787882523.839941:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787882523.840525:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787882523.840553:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787882523.840566:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.840578:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882523.840589:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787882523.840591:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa297fcb370 from 1 10000000:01000000:3.0:1787882523.840594:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787882523.840633:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfc00/0xf4731e8a7c5dedf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.840640:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfc00/0xf4731e8a7c5dedf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.840650:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfc00/0xf4731e8a7c5dedf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882523.840682:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563960320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.840741:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882523.840789:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf715e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.840844:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563960320 00000100:00100000:0.0:1787882523.840851:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563960320 00000100:00100000:0.0:1787882523.840919:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787882523.840930:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563960320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882523.840945:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882523.840959:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dedff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dedf8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882523.840994:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dedff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dedf8 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882523.841005:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dedff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dedf8 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882523.841015:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031c00, rc 0) 00000100:00100000:0.0:1787882523.841054:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563960320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882523.841060:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787882523.841231:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563960320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882523.841246:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfc00/0xf4731e8a7c5dedf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.841256:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfc00/0xf4731e8a7c5dedf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dedff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882523.841316:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563960448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882523.841348:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882523.841370:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf715e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882523.841495:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563960448 00000100:00100000:0.0:1787882523.841499:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563960448 00000100:00100000:0.0:1787882523.841525:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787882523.841530:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563960448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882523.841772:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563960448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (422us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787882523.841779:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787882523.841850:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563960448:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787882523.841910:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787882523.841917:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfc00/0xf4731e8a7c5dedf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882523.841926:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfc00/0xf4731e8a7c5dedf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882524.778157:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882525.802113:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882526.370723:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882526.370862:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541912832 00000100:00100000:0.0:1787882526.370928:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541912832 00000100:00100000:0.0:1787882526.370997:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00100000:0.0:1787882526.371010:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:5611:x1874730541912832:12345-192.168.206.21@tcp:101: 00010000:00010000:0.0:1787882526.371032:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882526.371057:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5dee06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842f51 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882526.371096:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5dee06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f51 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882526.371117:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5dee06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f51 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882526.371128:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030e00, rc 0) 00000100:00100000:0.0:1787882526.371216:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:5611:x1874730541912832:12345-192.168.206.21@tcp:101: Request processed in 209us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882526.371224:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00100000:3.0:1787882526.373774:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882526.374088:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541912960 00000100:00100000:2.0:1787882526.374120:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541912960 00000100:00100000:2.0:1787882526.374309:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00100000:2.0:1787882526.374323:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:5611:x1874730541912960:12345-192.168.206.21@tcp:501: 00000100:00100000:2.0:1787882526.374866:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:5611:x1874730541912960:12345-192.168.206.21@tcp:501: Request processed in 541us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882526.378209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882526.378260:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541913088 00000100:00100000:3.0:1787882526.378290:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541913088 00000100:00100000:2.0:1787882526.379051:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00100000:3.0:1787882526.379191:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 166 00000100:00100000:3.0:1787882526.379214:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:5611:x1874730541913088:12345-192.168.206.21@tcp:503: 00000100:00100000:3.0:1787882526.379526:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:5611:x1874730541913088:12345-192.168.206.21@tcp:503: Request processed in 315us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882526.379533:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 166 00000100:00100000:3.0:1787882526.389514:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882526.389669:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541913216 00000100:00100000:0.0:1787882526.389683:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541913216 00000100:00100000:0.0:1787882526.389796:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 167 00000100:00100000:0.0:1787882526.389809:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:6100:x1874730541913216:12345-192.168.206.21@tcp:502: 00000100:00100000:0.0:1787882526.390225:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:6100:x1874730541913216:12345-192.168.206.21@tcp:502: Request processed in 417us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882526.390234:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 167 00000100:00100000:3.0:1787882526.395122:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882526.397219:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541913344 00000100:00100000:1.0:1787882526.397237:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541913344 00000100:00100000:1.0:1787882526.397325:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 168 00000100:00100000:1.0:1787882526.397339:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:6100:x1874730541913344:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787882526.397748:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:6100:x1874730541913344:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 411us (2649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882526.397757:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 168 00000100:00100000:3.0:1787882526.401751:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882526.402665:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541913472 00000100:00100000:1.0:1787882526.402683:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541913472 00000100:00100000:1.0:1787882526.402752:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 169 00000100:00100000:1.0:1787882526.402764:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:5611:x1874730541913472:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882526.402784:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882526.402808:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2c21c7400/0xf4731e8a7c5dee0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842f58 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882526.402856:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2c21c7400/0xf4731e8a7c5dee0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f58 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882526.402911:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2c21c7400/0xf4731e8a7c5dee0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f58 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882526.402945:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2c21c7400, rc 0) 00000100:00100000:1.0:1787882526.403020:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5611:x1874730541913472:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 258us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882526.403028:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 169 00000100:00100000:3.0:1787882526.406259:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882526.406542:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541913600 00000100:00100000:1.0:1787882526.406555:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541913600 00000100:00100000:1.0:1787882526.406651:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 170 00000100:00100000:1.0:1787882526.406664:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5611:x1874730541913600:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882526.407720:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5611:x1874730541913600:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 1050us (1467us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787882526.407732:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 170 00010000:00010000:1.0:1787882526.827444:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882527.850005:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882527.906840:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882527.906925:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882527.906952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882527.906982:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882527.907017:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541913856 00000100:00100000:3.0:1787882527.907028:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541913856 00000100:00100000:3.0:1787882527.907102:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:3.0:1787882527.907114:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541913856:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882527.907203:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541913856:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882527.907212:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:3.0:1787882527.907239:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541913984 00000100:00100000:3.0:1787882527.907243:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541913984 00000100:00100000:3.0:1787882527.907267:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541914112 00000100:00100000:3.0:1787882527.907270:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541914112 00000100:00100000:3.0:1787882527.907285:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1787882527.907292:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541913984:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882527.907339:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541913984:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 48us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882527.907346:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1787882527.907358:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:3.0:1787882527.907364:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541914112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882527.907385:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541914112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 21us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882527.907391:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00080000:3.0:1787882527.907407:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787882527.907411:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787882527.907414:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882527.907679:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541913728 00000100:00100000:0.0:1787882527.907685:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541913728 00000100:00100000:0.0:1787882527.907717:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 171 00000100:00100000:0.0:1787882527.907725:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2358:x1874730541913728:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882527.915099:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2358:x1874730541913728:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 7135us (8037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882527.915118:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 171 00000100:00100000:2.0:1787882528.042339:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787882528.042374:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563960576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882528.042492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882528.042924:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563960576 00000100:00100000:1.0:1787882528.042937:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563960576 00000100:00100000:1.0:1787882528.043010:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787882528.043022:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563960576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882528.043069:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882528.043139:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563960576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882528.043148:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787882528.043173:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787882528.045083:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b9875c00 x1874730563960576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882528.045114:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563960576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787882528.047624:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563960832:0@lo:400:kworker.0 00000100:00100000:1.0:1787882528.047731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882528.047801:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787882528.047819:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563960704:0@lo:400:kworker.0 00000100:00100000:1.0:1787882528.047866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882528.047940:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563961216:0@lo:400:kworker.0 00000100:00100000:2.0:1787882528.047965:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563960960:0@lo:400:kworker.0 00000100:00100000:1.0:1787882528.047973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882528.048011:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730563961088:0@lo:400:kworker.0 00000100:00100000:2.0:1787882528.048012:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882528.048049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882528.048333:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563961216 00000100:00100000:1.0:1787882528.048344:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563961216 00000100:00100000:1.0:1787882528.048417:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787882528.048438:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563961216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882528.048583:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563961216:12345-0@lo:400:kworker.0 Request processed in 156us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882528.048592:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1787882528.048626:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787882528.048720:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563960832 00000100:00100000:1.0:1787882528.048722:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563960960 00000100:00100000:2.0:1787882528.048726:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563960832 00000100:00100000:1.0:1787882528.048729:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563960960 00000100:00100000:2.0:1787882528.048769:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563961088 00000100:00100000:2.0:1787882528.048773:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563961088 00000100:00100000:2.0:1787882528.048793:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787882528.048801:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563960832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882528.048827:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563960704 00000100:00100000:0.0:1787882528.048834:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563960704 00000100:00100000:2.0:1787882528.048853:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563960832:12345-0@lo:400:kworker.0 Request processed in 52us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882528.048861:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787882528.048902:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787882528.048909:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563960960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882528.049033:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787882528.049043:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563960704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882528.049204:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563960704:12345-0@lo:400:kworker.0 Request processed in 163us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882528.049211:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787882528.049722:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563960960:12345-0@lo:400:kworker.0 Request processed in 33us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882528.049734:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787882528.049758:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787882528.049768:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730563961088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882528.049832:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730563961088:12345-0@lo:400:kworker.0 Request processed in 66us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882528.049838:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787882528.049937:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730563961088:0@lo:400:kworker.0 00000100:00100000:2.0:1787882528.050405:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563960960:0@lo:400:kworker.0 00000100:00080000:1.0:1787882528.053362:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882528.054236:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563960704:0@lo:400:kworker.0 00010000:00080000:1.0:1787882528.054279:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1401880 x1874730563961216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882528.054297:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563961216:0@lo:400:kworker.0 00000100:00100000:1.0:1787882528.055162:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563960832:0@lo:400:kworker.0 00000020:00000080:1.0:1787882528.461062:0:8523:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0214eb90 20000000:00000080:1.0:1787882528.461088:0:8523:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa297f92800 uarg=0000000000000000 20000000:01000000:1.0:1787882528.461141:0:8523:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787882528.461148:0:8523:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787882528.461161:0:8523:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787882528.462849:0:8524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787882528.463097:0:8523:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787882528.469708:0:8523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787882528.469782:0:8523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787882528.470146:0:8523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787882528.470171:0:8523:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787882528.470269:0:8523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.470292:0:8523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa281523600/0xf4731e8a7c5deb89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deb82 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.470301:0:8523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5debeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5debe4 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.470309:0:8523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5decb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5decaf expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.470320:0:8523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2b7265400/0xf4731e8a7c5ded73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f20 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.470329:0:8523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.470379:0:8523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2b7265400/0xf4731e8a7c5ded73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f20 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.470398:0:8523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2b7265400/0xf4731e8a7c5ded73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f20 expref: 9 pid: 5837 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882528.470415:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1874730563961344:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882528.479262:0:8523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5decb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5decaf expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.479303:0:8523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5decb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5decaf expref: 18 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882528.479324:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1874730563961472:0@lo:104: 00000100:00100000:1.0:1787882528.479386:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882528.486964:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563961472 00000100:00100000:2.0:1787882528.486988:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563961472 00000100:00100000:2.0:1787882528.487088:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787882528.487102:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:8523:x1874730563961472:12345-0@lo:104: 00010000:00010000:2.0:1787882528.487136:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882528.487272:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787882528.487279:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:8523:x1874730563961472:12345-0@lo:104: Request processed in 181us (7893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882528.487309:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1787882528.487355:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882528.487374:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.487387:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813ffa00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882528.487391:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.487401:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882528.487408:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882528.487413:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787882528.487570:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.487591:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787882528.487667:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563961600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787882528.487734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787882528.488369:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.488379:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2813ffa00/0xf4731e8a7c5decaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5decb6 expref: -99 pid: 7647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.488398:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882528.488400:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882528.488402:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882528.489170:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882528.489232:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563961600 00000100:00100000:3.0:1787882528.489243:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563961600 00010000:00010000:3.0:1787882528.489303:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5decb6 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5decaf expref: 19 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882528.489338:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541914240 00000100:00100000:3.0:1787882528.489342:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541914240 00010000:00010000:3.0:1787882528.489358:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2b7265400/0xf4731e8a7c5ded73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f20 expref: 10 pid: 5837 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882528.489385:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787882528.489396:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563961600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882528.489416:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882528.489434:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5decb6 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5decaf expref: 19 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.489448:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5decb6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5decaf expref: 19 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.489497:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882528.489561:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563961600:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882528.489570:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787882528.489595:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:3.0:1787882528.489603:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2356:x1874730541914240:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882528.489618:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882528.489624:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2b7265400/0xf4731e8a7c5ded73 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f20 expref: 10 pid: 5837 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.489635:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2b7265400/0xf4731e8a7c5ded73 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f20 expref: 10 pid: 5837 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.489646:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882528.489693:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2356:x1874730541914240:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 91us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882528.489700:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:0.0:1787882528.493146:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563961600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787882528.494165:0:8523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5debeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5debe4 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.494192:0:8523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5debeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5debe4 expref: 18 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882528.494212:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1874730563961728:0@lo:104: 00000100:00100000:1.0:1787882528.494303:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787882528.494388:0:8523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa281523600/0xf4731e8a7c5deb89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5deb82 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.494397:0:8523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa281523600/0xf4731e8a7c5deb89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb82 expref: 18 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882528.494405:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1874730563961856:0@lo:104: 00000100:00100000:1.0:1787882528.494436:0:8523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787882528.494468:0:8523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b7265400/0xf4731e8a7c5ded73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f20 expref: 9 pid: 5837 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882528.494484:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1874730563961344:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882528.494498:0:8523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5decb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5decaf expref: 18 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882528.494531:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1874730563961472:0@lo:104: 00000100:00100000:0.0:1787882528.495530:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787882528.495573:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882528.495614:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563961728 00000100:00100000:0.0:1787882528.495623:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563961728 00000100:00100000:1.0:1787882528.495645:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563961856 00000100:00100000:1.0:1787882528.495651:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563961856 00000100:00100000:0.0:1787882528.495678:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787882528.495697:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b98ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:8523:x1874730563961728:12345-0@lo:104: 00010000:00010000:0.0:1787882528.495717:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.495793:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787882528.495815:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b98ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:8523:x1874730563961728:12345-0@lo:104: Request processed in 121us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882528.497026:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1874730563961728:0@lo:104: 00010000:00010000:1.0:1787882528.498093:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882528.498109:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.498122:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031600 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882528.498127:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.498141:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882528.498151:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882528.498157:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787882528.498283:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.498305:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882528.498335:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.498343:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5debe4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5debeb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882528.498376:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882528.498379:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882528.498381:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882528.500109:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563961984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882528.500233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882528.504732:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563961984 00000100:00100000:2.0:1787882528.504754:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563961984 00010000:00010000:2.0:1787882528.504952:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5debeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5debe4 expref: 18 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882528.505476:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787882528.505574:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787882528.505588:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:8523:x1874730563961856:12345-0@lo:104: 00010000:00010000:0.0:1787882528.505605:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7000/0xf4731e8a7c5deb82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882528.505727:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787882528.505734:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787882528.505742:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:8523:x1874730563961856:12345-0@lo:104: Request processed in 158us (10170us total) trans 0 rc 0/0 00010000:00010000:3.0:1787882528.505744:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787882528.505753:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787882528.505757:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7000/0xf4731e8a7c5deb82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.505780:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2c21c7000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882528.505786:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7000/0xf4731e8a7c5deb82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.505819:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7000/0xf4731e8a7c5deb82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882528.505829:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7000/0xf4731e8a7c5deb82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882528.505835:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787882528.505914:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7000/0xf4731e8a7c5deb82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.505922:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882528.505955:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7000/0xf4731e8a7c5deb82 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882528.506025:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563962112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787882528.506076:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882528.506158:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8523:1874730563961856:0@lo:104: 00010000:00010000:2.0:1787882528.506194:0:8523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.509553:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7000/0xf4731e8a7c5deb82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deb89 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.509594:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882528.509596:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882528.509600:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882528.509657:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:3307:x1874730563961984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882528.509691:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882528.509701:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5debeb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5debe4 expref: 18 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.509721:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5debeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5debe4 expref: 18 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.509742:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5debeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5debe4 expref: 18 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882528.509782:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882528.509905:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:3307:x1874730563961984:12345-0@lo:103:ldlm_bl.0 Request processed in 4167us (9672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882528.509916:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787882528.510230:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563962112 00000100:00100000:1.0:1787882528.510240:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563962112 00010000:00010000:0.0:1787882528.511208:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa281523600/0xf4731e8a7c5deb89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb82 expref: 17 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882528.511265:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787882528.511277:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:3308:x1874730563962112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787882528.511294:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882528.511300:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa281523600/0xf4731e8a7c5deb89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb82 expref: 17 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.511313:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa281523600/0xf4731e8a7c5deb89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5deb82 expref: 17 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.511329:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa281523600/0xf4731e8a7c5deb89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5deb82 expref: 17 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.511346:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.511373:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.511394:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.511401:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.511409:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882528.512504:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563961984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787882528.512768:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.512779:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2c21c6400 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882528.512784:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.512795:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.513723:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882528.513742:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882528.513972:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3308:x1874730563962112:12345-0@lo:103:ldlm_bl.0 Request processed in 2693us (7891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882528.513985:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787882528.514311:0:8523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882528.514322:0:8523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882528.514330:0:8523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2c21c6400/0xf4731e8a7c5dee14 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882528.515529:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563962112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882528.555239:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563962240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882528.555349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882528.561345:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563962240 00000100:00100000:1.0:1787882528.561366:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563962240 00000100:00100000:1.0:1787882528.561454:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787882528.561467:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563962240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882528.561518:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882528.561633:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563962240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (6285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882528.561642:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787882528.561763:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1400000 x1874730563962240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882528.561788:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563962240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787882528.874072:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882529.898905:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787882530.289561:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787882530.289571:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2c174b000 from 4 10000000:01000000:3.0:1787882530.289577:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787882530.289636:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882530.289649:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882530.289663:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882530.289695:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563962368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787882530.289784:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882530.290167:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563962368 00000100:00100000:0.0:1787882530.290188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563962368 00000100:00100000:0.0:1787882530.290254:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787882530.290266:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563962368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882530.290440:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882530.290461:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5dee22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dee1b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882530.290491:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5dee22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee1b expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882530.290504:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5dee22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee1b expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882530.290515:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031000, rc 0) 00000100:00100000:0.0:1787882530.291084:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563962368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 818us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882530.291094:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787882530.298230:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28601a540 going to sleep for 11 seconds 00000100:00100000:3.0:1787882530.298462:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563962368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882530.298498:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882530.298521:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882530.298613:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563962496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882530.298680:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882530.298722:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28601a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787882530.300269:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563962496 00000100:00100000:0.0:1787882530.300426:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563962496 00000100:00100000:0.0:1787882530.300513:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787882530.300526:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563962496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882530.302483:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563962496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1944us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882530.302502:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787882530.302649:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563962496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882530.302730:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563962624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787882530.304471:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882530.304554:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563962624 00000100:00100000:0.0:1787882530.304565:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563962624 00000100:00100000:0.0:1787882530.304635:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787882530.304650:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563962624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787882530.306761:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563962624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2102us (3944us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882530.306779:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787882530.306918:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298043f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787882530.306950:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563962624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882530.312196:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8586:1874730563962752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882530.312309:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882530.312472:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563962752 00000100:00100000:1.0:1787882530.312481:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563962752 00000100:00100000:1.0:1787882530.312540:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787882530.312552:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:8586:x1874730563962752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882530.312835:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:8586:x1874730563962752:12345-0@lo:502:llog_process_th.0 Request processed in 284us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.312844:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787882530.313020:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787882530.313050:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8586:1874730563962752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787882530.313155:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787882530.313167:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882530.313170:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787882530.313178:0:8586:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa2c174b000 00000020:00000080:2.0:1787882530.313182:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787882530.313282:0:8586:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8586:1874730563962880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882530.313331:0:8586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882530.313616:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563962880 00000100:00100000:2.0:1787882530.313621:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563962880 00000100:00100000:2.0:1787882530.313661:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787882530.313669:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:8586:x1874730563962880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882530.313923:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:8586:x1874730563962880:12345-0@lo:502:llog_process_th.0 Request processed in 254us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882530.313931:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787882530.313980:0:8586:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787882530.313994:0:8586:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8586:1874730563962880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787882530.314018:0:8586:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787882530.314024:0:8586:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882530.314025:0:8586:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787882530.314029:0:8586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787882530.324832:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787882530.324907:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787882530.324922:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.324937:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882530.324951:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787882530.324955:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa29d82f000 from 4 10000000:01000000:1.0:1787882530.324958:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787882530.325009:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.325018:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.325033:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882530.325069:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.325162:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882530.325223:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563963008 00000100:00100000:1.0:1787882530.325232:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563963008 00000100:00100000:1.0:1787882530.325294:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787882530.325304:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563963008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882530.325319:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882530.325335:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5dee30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dee29 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.325589:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5dee30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee29 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.325613:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5dee30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee29 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.325624:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813ff800, rc 0) 00000100:00100000:1.0:1787882530.325669:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563963008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 365us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.325677:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787882530.325738:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157240 going to sleep for 11 seconds 00000100:00100000:1.0:1787882530.325765:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882530.325781:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.325791:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882530.325891:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.325922:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882530.325949:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563963136 00000100:00100000:1.0:1787882530.325953:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563963136 00000100:00100000:1.0:1787882530.325981:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787882530.325988:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563963136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.329344:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563963136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2803us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.329442:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787882530.329531:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157240 going to sleep for 11 seconds 00000100:00100000:1.0:1787882530.329565:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.329643:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.329703:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882530.329742:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563963264 00000100:00100000:1.0:1787882530.329750:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563963264 00000100:00100000:1.0:1787882530.329795:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787882530.330915:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563963264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.332546:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563963264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2730us (2831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.333039:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787882530.333241:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157240 going to sleep for 11 seconds 00000100:00100000:0.0:1787882530.334429:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da94e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.335245:0:8590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8590:1874730563963392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882530.336922:0:8590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882530.336992:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563963392 00000100:00100000:1.0:1787882530.337002:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563963392 00000100:00100000:1.0:1787882530.337060:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787882530.337459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882530.337494:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541914368 00000100:00100000:0.0:1787882530.337498:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541914368 00000100:00100000:1.0:1787882530.340643:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8590:x1874730563963392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882530.340994:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8590:x1874730563963392:12345-0@lo:502:llog_process_th.0 Request processed in 374us (4076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882530.346942:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 182 00000100:00100000:0.0:1787882530.346968:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:5611:x1874730541914368:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882530.346996:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882530.347024:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dee37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842f5f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882530.347076:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dee37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f5f expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882530.347090:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dee37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f5f expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882530.347102:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030600, rc 0) 00000100:00100000:0.0:1787882530.347207:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5611:x1874730541914368:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 248us (9750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882530.347216:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 182 00000100:00100000:1.0:1787882530.352468:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787882530.352612:0:8590:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b717fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787882530.352657:0:8590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8590:1874730563963392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787882530.352708:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882530.352722:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882530.352725:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787882530.352732:0:8590:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa29d82f000 00000020:00000080:1.0:1787882530.352735:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787882530.353640:0:8590:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8590:1874730563963520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882530.353733:0:8590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882530.353790:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563963520 00000100:00100000:1.0:1787882530.353799:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563963520 00000100:00100000:1.0:1787882530.353949:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787882530.353960:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8590:x1874730563963520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882530.355780:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:8590:x1874730563963520:12345-0@lo:502:llog_process_th.0 Request processed in 1808us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.355798:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787882530.355918:0:8590:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479240 going to sleep for 11 seconds 00000100:00100000:1.0:1787882530.355949:0:8590:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8590:1874730563963520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787882530.355990:0:8590:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882530.356001:0:8590:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882530.356003:0:8590:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787882530.356008:0:8590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787882530.358175:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787882530.358218:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787882530.358233:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882530.358248:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882530.358262:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787882530.358266:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa285a97800 from 4 10000000:01000000:0.0:1787882530.358269:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787882530.358319:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882530.358328:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882530.358342:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882530.358959:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787882530.359054:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882530.359313:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298a170c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882530.359398:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882530.360977:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563963648 00000100:00100000:1.0:1787882530.360994:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563963648 00000100:00100000:1.0:1787882530.361059:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541914496 00000100:00100000:1.0:1787882530.361074:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541914496 00000100:00100000:1.0:1787882530.361098:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787882530.361110:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563963648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882530.361131:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882530.361154:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5dee45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dee3e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.361191:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5dee45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee3e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.361203:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5dee45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee3e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.361222:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813fe800, rc 0) 00000100:00100000:1.0:1787882530.361328:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563963648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 219us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.361336:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787882530.361393:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 185 00000100:00100000:1.0:1787882530.361402:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5611:x1874730541914496:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.361740:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5611:x1874730541914496:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 338us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.361750:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 185 00000100:00100000:1.0:1787882530.362980:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882530.363015:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.363029:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882530.365653:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.365751:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882530.366917:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2860549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882530.366975:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563963776 00000100:00100000:1.0:1787882530.366986:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563963776 00000100:00100000:1.0:1787882530.367060:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787882530.367072:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563963776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.374499:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563963776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7414us (8733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.374533:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787882530.375593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882530.378447:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541914624 00000100:00100000:1.0:1787882530.378464:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541914624 00000100:00100000:1.0:1787882530.378519:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 187 00000100:00100000:1.0:1787882530.378531:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5611:x1874730541914624:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.378826:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:5611:x1874730541914624:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 296us (3240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.378835:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 187 00000100:00100000:1.0:1787882530.379156:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.379221:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.379282:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882530.379322:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2860549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882530.379337:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563963904 00000100:00100000:1.0:1787882530.379341:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563963904 00000100:00100000:1.0:1787882530.379368:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787882530.379375:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563963904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.379530:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563963904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.379538:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787882530.379583:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563963904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882530.379809:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8592:1874730563964032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882530.379851:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882530.379918:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563964032 00000100:00100000:1.0:1787882530.379929:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563964032 00000100:00100000:1.0:1787882530.379953:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787882530.379960:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:8592:x1874730563964032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882530.380093:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:8592:x1874730563964032:12345-0@lo:502:llog_process_th.0 Request processed in 132us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.380100:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787882530.380128:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa286054840 going to sleep for 11 seconds 00000100:00100000:1.0:1787882530.380142:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8592:1874730563964032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787882530.380164:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882530.380175:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882530.380178:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787882530.380185:0:8592:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa285a97800 00000020:00000080:1.0:1787882530.380188:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787882530.380730:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8592:1874730563964160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882530.380776:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882530.380805:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563964160 00000100:00100000:1.0:1787882530.380810:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563964160 00000100:00100000:1.0:1787882530.380842:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787882530.380850:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:8592:x1874730563964160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882530.381028:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:8592:x1874730563964160:12345-0@lo:502:llog_process_th.0 Request processed in 178us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.381036:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787882530.381066:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749000 going to sleep for 11 seconds 00000100:00100000:1.0:1787882530.381082:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:8592:1874730563964160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787882530.381104:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882530.381110:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882530.381118:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787882530.381122:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787882530.381184:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787882530.381210:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787882530.395290:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882530.395307:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882530.400487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882530.400541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541914752 00000100:00100000:1.0:1787882530.400554:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541914752 00000100:00100000:1.0:1787882530.400620:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 191 00000100:00100000:1.0:1787882530.400633:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:6164:x1874730541914752:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787882530.400976:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:6164:x1874730541914752:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 344us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.400985:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 191 00000100:00100000:1.0:1787882530.422580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882530.427696:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541914880 00000100:00100000:1.0:1787882530.427717:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541914880 00000100:00100000:1.0:1787882530.427801:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 192 00000100:00100000:1.0:1787882530.427815:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa28660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:6164:x1874730541914880:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787882530.428229:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa28660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:6164:x1874730541914880:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 416us (5665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882530.428238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 192 00010000:00010000:1.0:1787882530.922025:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882531.948752:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882532.970995:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882533.039199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882533.039253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882533.039280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882533.039313:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541915136 00000100:00100000:1.0:1787882533.039325:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541915136 00000100:00100000:1.0:1787882533.039415:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:1.0:1787882533.039427:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541915136:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882533.039516:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541915136:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 91us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882533.039525:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00080000:1.0:1787882533.039550:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882533.039587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882533.039713:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541915264 00000100:00100000:1.0:1787882533.039717:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541915264 00000100:00100000:1.0:1787882533.039748:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541915392 00000100:00100000:1.0:1787882533.039751:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541915392 00000100:00100000:1.0:1787882533.039771:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:1.0:1787882533.039778:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541915264:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882533.039814:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541915264:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882533.039821:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:1.0:1787882533.039834:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:1.0:1787882533.039840:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541915392:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882533.039865:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541915392:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882533.039918:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00080000:1.0:1787882533.039933:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882533.039936:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882533.040092:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541915008 00000100:00100000:0.0:1787882533.040097:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541915008 00000100:00100000:0.0:1787882533.040139:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 193 00000100:00100000:0.0:1787882533.040145:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2357:x1874730541915008:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882533.040179:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2357:x1874730541915008:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882533.040186:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 193 00000100:00100000:2.0:1787882533.162509:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563964672:0@lo:400:kworker.0 00000100:00100000:2.0:1787882533.162601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882533.162687:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787882533.162695:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563964288:0@lo:400:kworker.0 00000100:00100000:2.0:1787882533.162727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882533.162752:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563964800:0@lo:400:kworker.0 00000100:00100000:2.0:1787882533.162778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882533.162817:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563964672 00000100:00100000:2.0:1787882533.162826:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563964672 00000100:00100000:2.0:1787882533.162921:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787882533.162931:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563964672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882533.162994:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563964672:12345-0@lo:400:kworker.0 Request processed in 64us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882533.163016:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787882533.163047:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563964288 00000100:00100000:2.0:1787882533.163051:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563964288 00000100:00100000:2.0:1787882533.163075:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787882533.163082:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563964288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882533.163110:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563964288:12345-0@lo:400:kworker.0 Request processed in 30us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882533.163116:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:2.0:1787882533.163140:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882533.163171:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563964288:0@lo:400:kworker.0 00010000:00080000:2.0:1787882533.163186:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b9876680 x1874730563964672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882533.163198:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563964672:0@lo:400:kworker.0 00000100:00100000:3.0:1787882533.163829:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563964416:0@lo:400:kworker.0 00000100:00100000:3.0:1787882533.163908:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882533.163931:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563964928:0@lo:400:kworker.0 00000100:00100000:3.0:1787882533.163954:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882533.163976:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787882533.163982:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563964544:0@lo:400:kworker.0 00000100:00100000:3.0:1787882533.164007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882533.164027:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563965056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882533.164071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882533.164113:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563964800 00000100:00100000:3.0:1787882533.164119:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563964800 00000100:00100000:3.0:1787882533.164165:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563964416 00000100:00100000:3.0:1787882533.164168:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563964416 00000100:00100000:3.0:1787882533.164182:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563964544 00000100:00100000:3.0:1787882533.164184:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563964544 00000100:00100000:3.0:1787882533.164199:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787882533.164207:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563964800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882533.164255:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563964800:12345-0@lo:400:kworker.0 Request processed in 48us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882533.164271:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787882533.164286:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787882533.164291:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563964416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882533.164320:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563964416:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882533.164325:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787882533.164336:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787882533.164341:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563964544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882533.164368:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563964544:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882533.164373:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787882533.164395:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563965056 00000100:00100000:1.0:1787882533.164621:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563964928 00000100:00100000:1.0:1787882533.164626:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563964928 00000100:00100000:1.0:1787882533.164670:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787882533.164679:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563964928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882533.164715:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563964928:12345-0@lo:400:kworker.0 Request processed in 39us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882533.164720:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787882533.165085:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787882533.165091:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882533.165128:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563964800:0@lo:400:kworker.0 00000100:00100000:3.0:1787882533.165427:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563965056 00000100:00100000:3.0:1787882533.165586:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787882533.165594:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563965056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787882533.165633:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882533.165690:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563965056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882533.165696:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787882533.165846:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563964544:0@lo:400:kworker.0 00010000:00080000:3.0:1787882533.165862:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1400700 x1874730563965056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882533.165913:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563965056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882533.165927:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563964416:0@lo:400:kworker.0 00010000:00080000:3.0:1787882533.165956:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b9874700 x1874730563964928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882533.165965:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563964928:0@lo:400:kworker.0 00000100:00100000:3.0:1787882533.675421:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787882533.675452:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563965184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882533.675545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882533.675657:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563965184 00000100:00100000:2.0:1787882533.675668:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563965184 00000100:00100000:2.0:1787882533.675726:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787882533.675736:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563965184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787882533.675780:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787882533.675836:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563965184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882533.675844:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787882533.676388:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9ca300 x1874730563965184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882533.676476:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563965184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787882534.002850:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882535.018379:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882536.042257:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787882536.368063:0:8822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787882537.066366:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882538.091501:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882538.154393:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882538.154444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882538.154540:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541915520 00000100:00100000:1.0:1787882538.154553:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541915520 00000100:00100000:1.0:1787882538.154614:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 195 00000100:00100000:1.0:1787882538.154627:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa28660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2357:x1874730541915520:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882538.154716:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa28660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2357:x1874730541915520:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 92us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882538.154725:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 195 00000100:00100000:3.0:1787882538.156654:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541915648 00000100:00100000:3.0:1787882538.156672:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541915648 00000100:00100000:3.0:1787882538.157091:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:3.0:1787882538.157105:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541915648:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:0.0:1787882538.157297:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882538.157470:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882538.157976:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541915776 00000100:00100000:0.0:1787882538.157985:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541915776 00000100:00100000:3.0:1787882538.158122:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541915648:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1019us (3675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882538.158133:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:0.0:1787882538.158659:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:0.0:1787882538.158675:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2355:x1874730541915776:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:0.0:1787882538.158721:0:6710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5ded81 00000100:00080000:0.0:1787882538.158733:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9fa2c159b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787882538.158779:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787882538.159260:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+2:2355:x1874730541915776:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 590us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882538.159269:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00010000:00010000:0.0:1787882538.159345:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882538.162810:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882538.163341:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541915904 00000100:00100000:0.0:1787882538.163354:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541915904 00000100:00080000:1.0:1787882538.167687:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882538.167702:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882538.173971:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1787882538.173994:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2355:x1874730541915904:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:0.0:1787882538.174058:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5ded88 00000100:00080000:0.0:1787882538.174074:0:6709:0:(import.c:65:import_set_state_nolock()) ffff9fa2c159d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787882538.174120:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1787882538.177517:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882538.178344:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+2:2355:x1874730541915904:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 4347us (15652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882538.178360:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:1.0:1787882538.282429:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563965696:0@lo:400:kworker.0 00000100:00100000:1.0:1787882538.282521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882538.282713:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563965312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882538.282758:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882538.282825:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563965824:0@lo:400:kworker.0 00000100:00100000:0.0:1787882538.282850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882538.283271:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563965440:0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.283315:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882538.283349:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563965952:0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.283394:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563965568:0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.283448:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563965824 00000100:00100000:3.0:1787882538.283456:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563965824 00000100:00100000:3.0:1787882538.283536:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787882538.283547:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563965824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.283605:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563965824:12345-0@lo:400:kworker.0 Request processed in 60us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882538.283614:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787882538.283641:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563965440 00000100:00100000:3.0:1787882538.283644:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563965440 00000100:00100000:3.0:1787882538.283670:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787882538.283676:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563965440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.283710:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563965440:12345-0@lo:400:kworker.0 Request processed in 34us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882538.283718:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:1.0:1787882538.284116:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787882538.284291:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563965312 00000100:00100000:1.0:1787882538.284298:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563965312 00000100:00100000:1.0:1787882538.284343:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787882538.284350:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563965312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882538.284398:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882538.284446:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563965312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882538.284453:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787882538.284550:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9c8a80 x1874730563965312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882538.284575:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563965312:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787882538.284589:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b9876d80 x1874730563965824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882538.284598:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563965824:0@lo:400:kworker.0 00000100:00100000:2.0:1787882538.285074:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563965696 00000100:00100000:2.0:1787882538.285081:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563965696 00000100:00100000:2.0:1787882538.286381:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787882538.286405:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563965696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882538.286504:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563965696:12345-0@lo:400:kworker.0 Request processed in 110us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882538.286512:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787882538.287340:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563965696:0@lo:400:kworker.0 00000100:00080000:1.0:1787882538.287388:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882538.287430:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882538.287482:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563965440:0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.288367:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882538.288425:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563966080:0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.288487:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882538.288537:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563965952 00000100:00100000:3.0:1787882538.288545:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563965952 00000100:00100000:3.0:1787882538.288605:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563965568 00000100:00100000:3.0:1787882538.288608:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563965568 00000100:00100000:3.0:1787882538.288629:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787882538.288639:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563965952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.288700:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563965952:12345-0@lo:400:kworker.0 Request processed in 62us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882538.288708:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787882538.288728:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787882538.288745:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563965568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.288784:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563965568:12345-0@lo:400:kworker.0 Request processed in 41us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882538.288791:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787882538.288827:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563965568:0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.288858:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563965952:0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.288906:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563966080 00000100:00100000:3.0:1787882538.288910:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563966080 00000100:00100000:3.0:1787882538.288939:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787882538.288946:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563966080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882538.288990:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563966080:12345-0@lo:400:kworker.0 Request processed in 44us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882538.288996:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787882538.289020:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b9877480 x1874730563966080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882538.289032:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563966080:0@lo:400:kworker.0 00000100:00080000:3.0:1787882538.289050:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787882538.289054:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882538.794113:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563966208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787882538.794223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882538.794482:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563966208 00000100:00100000:3.0:1787882538.794493:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563966208 00000100:00100000:3.0:1787882538.794559:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787882538.794572:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563966208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787882538.794619:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882538.794682:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563966208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882538.794704:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787882538.794772:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9c9500 x1874730563966208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882538.794794:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563966208:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787882538.943508:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000020:00000080:3.0:1787882538.943522:0:6737:0:(genops.c:885:class_export_put()) final put ffff9fa2c159c000/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000020:00000080:0.0:1787882538.943607:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2c159c000/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 for lustre-OST0000 00000020:00000080:0.0:1787882538.943677:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2c159b800 for lustre-OST0000 00010000:00010000:2.0:1787882539.114170:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882540.142799:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882541.163070:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787882542.159538:0:9068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing yml_node 00010000:00010000:3.0:1787882542.190796:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787882542.472441:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000020:00000080:1.0:1787882542.472455:0:7664:0:(genops.c:885:class_export_put()) final put ffff9fa2c159e800/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000020:00000080:0.0:1787882542.472557:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2c159e800/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 for lustre-OST0001 00000020:00000080:0.0:1787882542.472833:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2c159d000 for lustre-OST0001 00010000:00010000:2.0:1787882543.216760:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882543.267251:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882543.267628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882543.267669:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541916160 00000100:00100000:1.0:1787882543.267685:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541916160 00000100:00100000:1.0:1787882543.267776:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:1.0:1787882543.267789:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541916160:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882543.267905:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541916160:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 118us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882543.267913:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00080000:1.0:1787882543.267936:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882543.268196:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541916032 00000100:00100000:3.0:1787882543.268201:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541916032 00000100:00100000:3.0:1787882543.268313:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 197 00000100:00100000:3.0:1787882543.268322:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2358:x1874730541916032:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882543.268376:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2358:x1874730541916032:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 55us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882543.268384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 197 00000100:00100000:0.0:1787882543.405008:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563966336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882543.405128:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882543.405430:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563966336 00000100:00100000:3.0:1787882543.405450:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563966336 00000100:00100000:3.0:1787882543.405524:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787882543.405535:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563966336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787882543.405579:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882543.409917:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563966336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4367us (4784us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882543.409937:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787882543.410072:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787882543.412013:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563966592:0@lo:400:kworker.0 00000100:00100000:1.0:1787882543.412035:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563966464:0@lo:400:kworker.0 00000100:00100000:1.0:1787882543.412122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882543.412174:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563966976:0@lo:400:kworker.0 00000100:00100000:1.0:1787882543.412206:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882543.412290:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563966976 00000100:00100000:1.0:1787882543.412300:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563966976 00000100:00100000:3.0:1787882543.412355:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882543.412380:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787882543.412394:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563966976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882543.412408:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563966592 00000100:00100000:3.0:1787882543.412414:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563966592 00000100:00100000:3.0:1787882543.412514:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787882543.412523:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563966592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882543.412569:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563966592:12345-0@lo:400:kworker.0 Request processed in 47us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882543.412577:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787882543.412608:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882543.412639:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563966592:0@lo:400:kworker.0 00000100:00100000:1.0:1787882543.413126:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563966976:12345-0@lo:400:kworker.0 Request processed in 735us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882543.413134:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787882543.413162:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563966464 00000100:00100000:1.0:1787882543.413167:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563966464 00000100:00100000:1.0:1787882543.413199:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787882543.413207:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563966464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882543.413240:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563966464:12345-0@lo:400:kworker.0 Request processed in 35us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882543.413247:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787882543.413280:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563966720:0@lo:400:kworker.0 00000100:00100000:1.0:1787882543.413311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882543.413333:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787882543.413340:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563966848:0@lo:400:kworker.0 00000100:00100000:1.0:1787882543.413375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882543.413402:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563966720 00000100:00100000:1.0:1787882543.413406:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563966720 00000100:00080000:3.0:1787882543.413637:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882543.413651:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563966848 00000100:00100000:3.0:1787882543.413655:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563966848 00000100:00100000:1.0:1787882543.413656:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787882543.413668:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563966720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882543.413720:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563966720:12345-0@lo:400:kworker.0 Request processed in 55us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882543.413727:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787882543.413740:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787882543.413746:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563966848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882543.413773:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563966848:12345-0@lo:400:kworker.0 Request processed in 28us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882543.413779:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787882543.413816:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563966848:0@lo:400:kworker.0 00000100:00100000:1.0:1787882543.413825:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563966720:0@lo:400:kworker.0 00010000:00080000:0.0:1787882543.413914:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9c9500 x1874730563966336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882543.413951:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563966336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787882543.413986:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563966464:0@lo:400:kworker.0 00010000:00080000:1.0:1787882543.414005:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9ca680 x1874730563966976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882543.414015:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563966976:0@lo:400:kworker.0 00000100:00080000:2.0:1787882543.414302:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882543.914521:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787882543.914551:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563967104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787882543.914634:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882543.914719:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563967104 00000100:00100000:0.0:1787882543.914728:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563967104 00000100:00100000:0.0:1787882543.914780:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787882543.914790:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563967104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787882543.914833:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882543.914899:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563967104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882543.914907:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787882543.914957:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2bf3d4e00 x1874730563967104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882543.915090:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563967104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787882544.234199:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882545.264758:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787882546.212274:0:9259:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.84 00010000:00010000:3.0:1787882546.282044:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882547.309523:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882548.330008:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882548.386134:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882548.386214:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541916288 00000100:00100000:3.0:1787882548.386223:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541916288 00000100:00100000:3.0:1787882548.386278:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 199 00000100:00100000:3.0:1787882548.386288:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2359:x1874730541916288:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882548.386366:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2359:x1874730541916288:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 78us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882548.386374:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 199 00000100:00100000:3.0:1787882548.393376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882548.393447:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541916416 00000100:00100000:1.0:1787882548.393456:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541916416 00000100:00100000:1.0:1787882548.393533:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:1.0:1787882548.393544:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541916416:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882548.393614:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541916416:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 73us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882548.393621:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00080000:3.0:1787882548.393967:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882548.522235:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563967232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787882548.522332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882548.522461:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563967232 00000100:00100000:3.0:1787882548.522470:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563967232 00000100:00100000:3.0:1787882548.522533:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787882548.522542:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563967232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787882548.522582:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882548.522628:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563967232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882548.522636:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787882548.522840:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787882548.522902:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9caa00 x1874730563967232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882548.522922:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563967232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882548.524462:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563967488:0@lo:400:kworker.0 00000100:00100000:2.0:1787882548.524524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882548.524560:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787882548.524566:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563967616:0@lo:400:kworker.0 00000100:00100000:2.0:1787882548.524588:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882548.524622:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563967488 00000100:00100000:2.0:1787882548.524628:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563967488 00000100:00100000:2.0:1787882548.524679:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563967616 00000100:00100000:2.0:1787882548.524682:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563967616 00000100:00100000:2.0:1787882548.524713:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787882548.524721:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563967488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882548.524767:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563967488:12345-0@lo:400:kworker.0 Request processed in 47us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882548.524775:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787882548.524797:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787882548.524804:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563967616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882548.524831:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563967616:12345-0@lo:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882548.524850:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787882548.524898:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882548.524925:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563967616:0@lo:400:kworker.0 00000100:00100000:2.0:1787882548.524935:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563967488:0@lo:400:kworker.0 00000100:00100000:3.0:1787882548.525023:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563967744:0@lo:400:kworker.0 00000100:00100000:3.0:1787882548.525053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882548.525080:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787882548.525087:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563967360:0@lo:400:kworker.0 00000100:00100000:3.0:1787882548.525113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882548.525140:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563967872:0@lo:400:kworker.0 00000100:00100000:3.0:1787882548.525162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882548.525188:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563967360 00000100:00100000:3.0:1787882548.525191:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563967360 00000100:00100000:3.0:1787882548.525215:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787882548.525221:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563967360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882548.525255:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563967360:12345-0@lo:400:kworker.0 Request processed in 33us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882548.525260:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787882548.525287:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563967872 00000100:00100000:3.0:1787882548.525290:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563967872 00000100:00100000:3.0:1787882548.525333:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787882548.525340:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563967872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882548.525372:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563967872:12345-0@lo:400:kworker.0 Request processed in 32us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882548.525378:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787882548.525405:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563967360:0@lo:400:kworker.0 00010000:00080000:3.0:1787882548.525423:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b9877b80 x1874730563967872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882548.525432:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563967872:0@lo:400:kworker.0 00000100:00080000:2.0:1787882548.526007:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787882548.526020:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563967744 00000100:00100000:2.0:1787882548.526025:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563967744 00000100:00100000:2.0:1787882548.526100:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787882548.526107:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563967744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882548.526162:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563967744:12345-0@lo:400:kworker.0 Request processed in 56us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882548.526169:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787882548.528109:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563967744:0@lo:400:kworker.0 00000100:00080000:0.0:1787882548.529859:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787882548.691703:0:9357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.84 00000100:00100000:3.0:1787882549.040309:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563968000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882549.040385:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882549.040460:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563968000 00000100:00100000:3.0:1787882549.040469:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563968000 00000100:00100000:3.0:1787882549.040516:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787882549.040525:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563968000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787882549.040563:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882549.040620:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563968000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882549.040628:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787882549.040671:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9cb100 x1874730563968000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882565 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882549.040689:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563968000:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787882549.358852:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882550.378776:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787882551.324643:0:9454:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.84 00010000:00010000:2.0:1787882551.404456:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882552.426352:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787882553.437447:0:9503:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 22:02:31 EDT 2026 00010000:00010000:0.0:1787882553.460738:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882553.517551:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882553.517613:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882553.517654:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541916544 00000100:00100000:0.0:1787882553.517673:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541916544 00000100:00100000:0.0:1787882553.517736:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 201 00000100:00100000:0.0:1787882553.517749:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2356:x1874730541916544:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882553.517835:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2356:x1874730541916544:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 89us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882553.517845:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 201 00000100:00100000:1.0:1787882553.518015:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541916672 00000100:00100000:1.0:1787882553.518020:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541916672 00000100:00100000:1.0:1787882553.518149:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:1.0:1787882553.518159:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541916672:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882553.518197:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541916672:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 41us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882553.518204:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00080000:0.0:1787882553.519604:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882553.644393:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563968384:0@lo:400:kworker.0 00000100:00100000:2.0:1787882553.644488:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882553.644569:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787882553.644577:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563968256:0@lo:400:kworker.0 00000100:00100000:2.0:1787882553.644602:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882553.644620:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563968768:0@lo:400:kworker.0 00000100:00100000:2.0:1787882553.644649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882553.644695:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563968384 00000100:00100000:2.0:1787882553.644705:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563968384 00000100:00100000:2.0:1787882553.644772:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563968256 00000100:00100000:2.0:1787882553.644776:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563968256 00000100:00100000:2.0:1787882553.644801:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787882553.644827:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563968384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882553.644915:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563968384:12345-0@lo:400:kworker.0 Request processed in 90us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882553.644923:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787882553.644952:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787882553.644960:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563968256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882553.644989:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563968256:12345-0@lo:400:kworker.0 Request processed in 30us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882553.644994:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787882553.645015:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563968768 00000100:00100000:2.0:1787882553.645019:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563968768 00000100:00100000:2.0:1787882553.645050:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787882553.645057:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563968768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882553.645089:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563968768:12345-0@lo:400:kworker.0 Request processed in 33us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882553.645096:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787882553.645114:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787882553.645119:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882553.645160:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563968256:0@lo:400:kworker.0 00010000:00080000:2.0:1787882553.645175:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b9877100 x1874730563968768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882553.645187:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563968768:0@lo:400:kworker.0 00000100:00100000:2.0:1787882553.645196:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563968384:0@lo:400:kworker.0 00000100:00100000:3.0:1787882553.649405:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563968512:0@lo:400:kworker.0 00000100:00100000:3.0:1787882553.649505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882553.649596:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787882553.649606:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563968128:0@lo:400:kworker.0 00000100:00100000:3.0:1787882553.649642:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882553.649666:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563968640:0@lo:400:kworker.0 00000100:00100000:3.0:1787882553.649709:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882553.649744:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787882553.649754:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563968896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882553.649782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882553.649816:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563968640 00000100:00100000:3.0:1787882553.649825:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563968640 00000100:00100000:3.0:1787882553.649926:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787882553.649937:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563968640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882553.650004:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563968640:12345-0@lo:400:kworker.0 Request processed in 68us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882553.650011:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787882553.650038:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563968512 00000100:00100000:3.0:1787882553.650042:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563968512 00000100:00100000:3.0:1787882553.650071:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787882553.650078:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563968512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882553.650109:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563968512:12345-0@lo:400:kworker.0 Request processed in 32us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882553.650116:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787882553.650138:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563968128 00000100:00100000:3.0:1787882553.650142:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563968128 00000100:00100000:2.0:1787882553.651307:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563968896 00000100:00100000:2.0:1787882553.651319:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563968896 00000100:00100000:2.0:1787882553.651382:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787882553.651392:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563968896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787882553.651431:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787882553.651507:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563968896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882553.651515:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787882553.651547:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787882553.651553:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882553.652075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787882553.652086:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563968128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882553.652137:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563968128:12345-0@lo:400:kworker.0 Request processed in 55us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882553.652145:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1787882553.656549:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563968128:0@lo:400:kworker.0 00000100:00100000:2.0:1787882553.656580:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563968640:0@lo:400:kworker.0 00010000:00080000:2.0:1787882553.656599:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b9874700 x1874730563968512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882553.656612:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563968512:0@lo:400:kworker.0 00010000:00080000:3.0:1787882553.657124:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9cb100 x1874730563968896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882553.657309:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563968896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882554.159778:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563969024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787882554.159841:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882554.159977:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563969024 00000100:00100000:0.0:1787882554.159984:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563969024 00000100:00100000:0.0:1787882554.160034:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787882554.160042:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563969024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787882554.160073:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882554.160116:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563969024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882554.160122:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787882554.160170:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2bf3d6d80 x1874730563969024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882554.160187:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563969024:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787882554.475012:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882555.500214:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882556.522094:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882557.546186:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882558.571384:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882558.632902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882558.633363:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541916928 00000100:00100000:3.0:1787882558.633373:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541916928 00000100:00100000:3.0:1787882558.633432:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:3.0:1787882558.633442:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541916928:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882558.639732:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541916928:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 6280us (6859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882558.639748:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00080000:3.0:1787882558.639790:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882558.645985:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882558.652838:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541916800 00000100:00100000:0.0:1787882558.652850:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541916800 00000100:00100000:0.0:1787882558.652938:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 203 00000100:00100000:0.0:1787882558.652949:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2359:x1874730541916800:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882558.653028:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2359:x1874730541916800:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 82us (7052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882558.653743:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 203 00000100:00100000:0.0:1787882558.768979:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563969152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882558.769065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882558.769174:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563969152 00000100:00100000:0.0:1787882558.769181:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563969152 00000100:00100000:0.0:1787882558.769238:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787882558.769248:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563969152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882558.769296:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882558.769340:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563969152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882558.769348:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787882558.769376:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787882558.769400:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9cb100 x1874730563969152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882558.769419:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563969152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882558.770725:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563969536:0@lo:400:kworker.0 00000100:00100000:3.0:1787882558.770784:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882558.770817:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787882558.770823:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563969664:0@lo:400:kworker.0 00000100:00100000:3.0:1787882558.770864:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882558.770961:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563969536 00000100:00100000:3.0:1787882558.770969:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563969536 00000100:00100000:3.0:1787882558.771016:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563969664 00000100:00100000:3.0:1787882558.771019:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563969664 00000100:00100000:3.0:1787882558.771048:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787882558.771056:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563969536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882558.771106:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563969536:12345-0@lo:400:kworker.0 Request processed in 50us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882558.771112:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787882558.771146:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787882558.771162:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563969664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882558.771190:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563969664:12345-0@lo:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882558.771196:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1787882558.771212:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882558.771241:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563969664:0@lo:400:kworker.0 00000100:00100000:3.0:1787882558.771250:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563969536:0@lo:400:kworker.0 00000100:00100000:2.0:1787882558.771499:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563969408:0@lo:400:kworker.0 00000100:00100000:2.0:1787882558.771535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882558.771565:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787882558.771571:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563969280:0@lo:400:kworker.0 00000100:00100000:2.0:1787882558.771599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882558.771628:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563969792:0@lo:400:kworker.0 00000100:00100000:2.0:1787882558.771653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882558.771700:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563969408 00000100:00100000:2.0:1787882558.771706:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563969408 00000100:00100000:2.0:1787882558.771735:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787882558.771743:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563969408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882558.771779:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563969408:12345-0@lo:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882558.771797:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787882558.771823:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563969280 00000100:00100000:2.0:1787882558.771827:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563969280 00000100:00100000:2.0:1787882558.771849:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787882558.771855:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563969280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882558.771907:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563969280:12345-0@lo:400:kworker.0 Request processed in 52us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882558.771913:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787882558.773051:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563969792 00000100:00100000:2.0:1787882558.773062:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563969792 00000100:00100000:2.0:1787882558.773111:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787882558.773120:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563969792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882558.773179:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563969792:12345-0@lo:400:kworker.0 Request processed in 61us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882558.773186:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787882558.773224:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563969280:0@lo:400:kworker.0 00010000:00080000:2.0:1787882558.773238:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9cb100 x1874730563969792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882558.773249:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563969792:0@lo:400:kworker.0 00000100:00100000:2.0:1787882558.773279:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563969408:0@lo:400:kworker.0 00000100:00080000:2.0:1787882558.773344:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787882559.278229:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787882559.279575:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563969920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787882559.279650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882559.285717:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563969920 00000100:00100000:1.0:1787882559.285727:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563969920 00000100:00100000:1.0:1787882559.285787:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787882559.285797:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563969920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882559.285823:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882559.285916:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563969920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (6267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882559.285924:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787882559.286007:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29da94a80 x1874730563969920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882559.286035:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563969920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787882559.595133:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882560.621129:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882561.644036:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882562.667430:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882563.690978:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882563.745785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882563.745842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882563.745982:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541917184 00000100:00100000:3.0:1787882563.745992:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541917184 00000100:00100000:3.0:1787882563.746066:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:3.0:1787882563.746077:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541917184:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882563.746163:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541917184:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 88us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882563.746171:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00080000:2.0:1787882563.746494:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882563.748797:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541917056 00000100:00100000:0.0:1787882563.748825:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541917056 00000100:00100000:0.0:1787882563.748920:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 205 00000100:00100000:0.0:1787882563.748930:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2359:x1874730541917056:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882563.749059:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2359:x1874730541917056:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (3162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882563.749068:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 205 00000100:00100000:3.0:1787882563.885083:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787882563.885105:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563970048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882563.885165:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882563.885173:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563970432:0@lo:400:kworker.0 00000100:00100000:1.0:1787882563.885201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882563.885215:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563970176:0@lo:400:kworker.0 00000100:00100000:1.0:1787882563.885218:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787882563.885222:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563970304:0@lo:400:kworker.0 00000100:00100000:3.0:1787882563.885254:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882563.885260:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882563.885278:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563970816:0@lo:400:kworker.0 00000100:00100000:3.0:1787882563.885289:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730563970688:0@lo:400:kworker.0 00000100:00100000:1.0:1787882563.885300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882563.885307:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882563.885319:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787882563.885324:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563970560:0@lo:400:kworker.0 00000100:00100000:1.0:1787882563.885329:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563970432 00000100:00100000:1.0:1787882563.885335:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563970432 00000100:00100000:1.0:1787882563.885387:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563970304 00000100:00100000:1.0:1787882563.885390:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563970304 00000100:00100000:1.0:1787882563.885415:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563970688 00000100:00100000:1.0:1787882563.885418:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563970688 00000100:00100000:1.0:1787882563.885435:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787882563.885444:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563970432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882563.885496:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563970432:12345-0@lo:400:kworker.0 Request processed in 52us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882563.885503:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787882563.885518:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563970432:0@lo:400:kworker.0 00000100:00100000:1.0:1787882563.885520:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787882563.885525:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563970304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882563.885557:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563970304:12345-0@lo:400:kworker.0 Request processed in 31us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882563.885563:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787882563.885570:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563970304:0@lo:400:kworker.0 00000100:00100000:1.0:1787882563.885574:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787882563.885580:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730563970688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882563.885606:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730563970688:12345-0@lo:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882563.885612:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1787882563.885629:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882563.885942:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882563.885990:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730563970688:0@lo:400:kworker.0 00000100:00100000:3.0:1787882563.886018:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563970048 00000100:00100000:3.0:1787882563.886022:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563970048 00000100:00100000:3.0:1787882563.886055:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787882563.886062:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563970048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787882563.886089:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882563.886127:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563970048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882563.886133:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787882563.886157:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563970176 00000100:00100000:3.0:1787882563.886161:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563970176 00000100:00100000:3.0:1787882563.886181:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787882563.886187:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563970176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882563.886220:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563970176:12345-0@lo:400:kworker.0 Request processed in 32us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882563.886225:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787882563.886266:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563970816 00000100:00100000:3.0:1787882563.886270:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563970816 00000100:00100000:3.0:1787882563.886297:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563970560 00000100:00100000:3.0:1787882563.886300:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563970560 00000100:00100000:3.0:1787882563.886312:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787882563.886318:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563970816:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787882563.886325:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882563.886327:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882563.887120:0:6711:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787882563.887131:0:6711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787882563.887267:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787882563.887279:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563970560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882563.887340:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563970560:12345-0@lo:400:kworker.0 Request processed in 64us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882563.887347:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787882563.887776:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563970816:12345-0@lo:400:kworker.0 Request processed in 1454us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882563.887786:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787882563.887854:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29da94e00 x1874730563970560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882563.887895:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563970560:0@lo:400:kworker.0 00000100:00100000:3.0:1787882563.887910:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563970176:0@lo:400:kworker.0 00010000:00080000:3.0:1787882563.887921:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1548000 x1874730563970048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882563.887936:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563970048:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787882563.887996:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2a998ca80 x1874730563970816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882563.888007:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563970816:0@lo:400:kworker.0 00000100:00100000:3.0:1787882564.395689:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787882564.395722:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563970944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882564.395793:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882564.395932:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563970944 00000100:00100000:1.0:1787882564.395940:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563970944 00000100:00100000:1.0:1787882564.395990:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787882564.396000:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563970944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882564.396042:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882564.396084:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563970944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882564.396091:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787882564.396245:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2a998ce00 x1874730563970944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882564.396263:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563970944:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787882564.714249:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882565.738655:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882566.763910:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882567.787002:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882568.810851:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882568.872460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882568.872532:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882568.872574:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541917440 00000100:00100000:3.0:1787882568.872586:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541917440 00000100:00100000:3.0:1787882568.872663:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:3.0:1787882568.872676:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541917440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882568.872771:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541917440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 97us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882568.872780:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00080000:3.0:1787882568.872808:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882568.873309:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541917312 00000100:00100000:1.0:1787882568.873316:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541917312 00000100:00100000:1.0:1787882568.873369:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 207 00000100:00100000:1.0:1787882568.873378:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2358:x1874730541917312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882568.873416:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2358:x1874730541917312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882568.873423:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 207 00000100:00100000:2.0:1787882569.005276:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563971072:0@lo:400:kworker.0 00000100:00100000:3.0:1787882569.005672:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563971200:0@lo:400:kworker.0 00000100:00100000:3.0:1787882569.005802:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882569.006247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882569.006309:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563971584:0@lo:400:kworker.0 00000100:00100000:2.0:1787882569.006637:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563971328:0@lo:400:kworker.0 00000100:00100000:2.0:1787882569.006674:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563971456:0@lo:400:kworker.0 00000100:00100000:2.0:1787882569.006703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882569.006749:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563971072 00000100:00100000:0.0:1787882569.006759:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563971072 00000100:00100000:0.0:1787882569.006817:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1787882569.006828:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563971072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882569.006854:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563971712:0@lo:400:kworker.0 00000100:00100000:3.0:1787882569.006894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882569.006909:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563971072:12345-0@lo:400:kworker.0 Request processed in 83us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882569.006917:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787882569.007057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882569.007095:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563971456 00000100:00100000:0.0:1787882569.007099:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563971456 00000100:00100000:0.0:1787882569.007143:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563971712 00000100:00100000:0.0:1787882569.007154:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563971712 00000100:00100000:0.0:1787882569.007180:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787882569.007186:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563971456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882569.007238:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563971456:12345-0@lo:400:kworker.0 Request processed in 52us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882569.007244:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787882569.007258:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787882569.007263:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563971712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882569.007296:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563971712:12345-0@lo:400:kworker.0 Request processed in 33us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882569.007303:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1787882569.007344:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787882569.007349:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787882569.007385:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1589c00 x1874730563971712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882569.007400:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563971712:0@lo:400:kworker.0 00010000:00080000:3.0:1787882569.014277:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c158b480 x1874730563971456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882569.014300:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563971456:0@lo:400:kworker.0 00000100:00100000:1.0:1787882569.015186:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563971200 00000100:00100000:1.0:1787882569.015198:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563971200 00000100:00100000:1.0:1787882569.015301:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787882569.015313:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563971200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882569.015441:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563971200:12345-0@lo:400:kworker.0 Request processed in 131us (9639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882569.015470:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787882569.015703:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563971200:0@lo:400:kworker.0 00000100:00100000:2.0:1787882569.022084:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563971840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882569.022171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882569.022491:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563971328 00000100:00100000:0.0:1787882569.022502:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563971328 00000100:00100000:0.0:1787882569.022602:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787882569.022614:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563971328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882569.022694:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563971328:12345-0@lo:400:kworker.0 Request processed in 82us (15637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882569.022701:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787882569.023224:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c158b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563971328:0@lo:400:kworker.0 00000100:00080000:2.0:1787882569.024045:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882569.024076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882569.024186:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563971072:0@lo:400:kworker.0 00000100:00100000:1.0:1787882569.026104:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563971840 00000100:00100000:1.0:1787882569.026123:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563971840 00000100:00100000:1.0:1787882569.026188:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787882569.026199:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563971840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882569.026257:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882569.026351:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563971840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (4178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882569.026359:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787882569.026415:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2a998d180 x1874730563971840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882569.026440:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563971840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882569.035964:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563971584 00000100:00100000:3.0:1787882569.036149:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563971584 00000100:00100000:3.0:1787882569.036342:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787882569.036357:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563971584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882569.036482:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563971584:12345-0@lo:400:kworker.0 Request processed in 129us (12408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882569.036490:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787882569.036570:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563971584:0@lo:400:kworker.0 00000100:00080000:1.0:1787882569.036645:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882569.515317:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563971968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787882569.515422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882569.515756:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563971968 00000100:00100000:1.0:1787882569.515769:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563971968 00000100:00100000:1.0:1787882569.515836:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787882569.515847:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563971968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882569.515918:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882569.516025:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563971968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882569.516036:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787882569.516104:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2a998d180 x1874730563971968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882569.516124:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563971968:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787882569.625566:0:10135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:02:47 (1787882567) === 00010000:00010000:3.0:1787882569.834444:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882570.154630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882570.154726:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541917568 00000100:00100000:0.0:1787882570.154737:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541917568 00000100:00100000:0.0:1787882570.154799:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 209 00000100:00100000:0.0:1787882570.154821:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:8159:x1874730541917568:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787882570.154836:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882570.154854:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5dee4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842f66 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882570.154918:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5dee4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f66 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882570.154931:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5dee4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f66 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882570.154941:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030c00, rc 0) 00000100:00100000:0.0:1787882570.155006:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:8159:x1874730541917568:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 198us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882570.155014:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 209 00000100:00100000:3.0:1787882570.166597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882570.166696:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541917696 00000100:00100000:0.0:1787882570.166706:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541917696 00000100:00100000:0.0:1787882570.166761:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 210 00000100:00100000:0.0:1787882570.166771:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:8159:x1874730541917696:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787882570.167510:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:8159:x1874730541917696:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 735us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882570.167520:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 210 00000100:00100000:3.0:1787882570.171623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882570.171713:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541917824 00000100:00100000:2.0:1787882570.171722:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541917824 00000100:00100000:2.0:1787882570.171771:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 211 00000100:00100000:2.0:1787882570.171782:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:8159:x1874730541917824:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787882570.172065:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:8159:x1874730541917824:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 275us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882570.172080:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 211 00000100:00100000:3.0:1787882570.178541:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882570.178750:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541917952 00000100:00100000:0.0:1787882570.178760:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541917952 00000100:00100000:0.0:1787882570.178826:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 212 00000100:00100000:0.0:1787882570.178837:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:8163:x1874730541917952:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787882570.179126:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:8163:x1874730541917952:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 290us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882570.179133:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 212 00000100:00100000:0.0:1787882570.198970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882570.199391:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541918080 00000100:00100000:3.0:1787882570.199400:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541918080 00000100:00100000:3.0:1787882570.199459:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 213 00000100:00100000:3.0:1787882570.199469:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:8163:x1874730541918080:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787882570.199750:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:8163:x1874730541918080:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 281us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882570.199758:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 213 00000100:00100000:3.0:1787882570.209963:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882570.210434:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541918208 00000100:00100000:2.0:1787882570.210449:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541918208 00000100:00100000:2.0:1787882570.210518:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 214 00000100:00100000:2.0:1787882570.210530:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:8159:x1874730541918208:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787882570.210551:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882570.210574:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b7264c00/0xf4731e8a7c5dee53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842f90 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882570.210612:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b7264c00/0xf4731e8a7c5dee53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f90 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882570.210626:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b7264c00/0xf4731e8a7c5dee53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f90 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882570.210637:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264c00, rc 0) 00000100:00100000:2.0:1787882570.210719:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:8159:x1874730541918208:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 190us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882570.210727:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 214 00000100:00100000:1.0:1787882570.218209:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882570.218501:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541918336 00000100:00100000:0.0:1787882570.218511:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541918336 00000100:00100000:0.0:1787882570.218567:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 215 00000100:00100000:0.0:1787882570.218577:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:8159:x1874730541918336:12345-192.168.206.21@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787882570.218601:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787882570.218619:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787882570.218623:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787882570.218626:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787882570.218628:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787882570.227565:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:8159:x1874730541918336:12345-192.168.206.21@tcp:256:mount.lustre.0 Request processed in 8978us (9362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882570.227579:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 215 00000100:00100000:3.0:1787882570.233037:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882570.233219:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541918464 00000100:00100000:0.0:1787882570.233228:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541918464 00000100:00100000:2.0:1787882570.233894:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 216 00000100:00100000:2.0:1787882570.233910:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:8159:x1874730541918464:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787882570.233925:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882570.233942:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5dee5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842f97 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882570.233970:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5dee5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f97 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882570.233996:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5dee5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f97 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882570.234005:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265600, rc 0) 00000100:00100000:2.0:1787882570.234071:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:8159:x1874730541918464:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 166us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882570.234078:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 216 00000100:00100000:3.0:1787882570.236474:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882570.236682:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541918592 00000100:00100000:1.0:1787882570.236695:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541918592 00000100:00100000:1.0:1787882570.236773:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 217 00000100:00100000:1.0:1787882570.236785:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:8159:x1874730541918592:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787882570.237350:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:8159:x1874730541918592:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 564us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882570.237360:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 217 00000100:00100000:3.0:1787882570.239935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882570.240100:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541918720 00000100:00100000:0.0:1787882570.240112:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541918720 00000100:00100000:0.0:1787882570.240290:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 218 00000100:00100000:0.0:1787882570.240303:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:8159:x1874730541918720:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787882570.240598:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:8159:x1874730541918720:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 296us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882570.240607:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 218 00000100:00100000:3.0:1787882570.243577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882570.243856:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541918848 00000100:00100000:2.0:1787882570.243892:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541918848 00000100:00100000:2.0:1787882570.243964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 219 00000100:00100000:2.0:1787882570.243985:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:8167:x1874730541918848:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787882570.244339:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:8167:x1874730541918848:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 356us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882570.244349:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 219 00000100:00100000:3.0:1787882570.247263:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882570.247469:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541918976 00000100:00100000:1.0:1787882570.247482:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541918976 00000100:00100000:1.0:1787882570.247553:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 220 00000100:00100000:1.0:1787882570.247565:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:8167:x1874730541918976:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787882570.247923:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:8167:x1874730541918976:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 359us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882570.247932:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 220 00000100:00100000:3.0:1787882570.263017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882570.263052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882570.263567:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541919104 00000100:00100000:0.0:1787882570.263581:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541919104 00000100:00100000:0.0:1787882570.263639:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541919488 00000100:00100000:0.0:1787882570.263643:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541919488 00000100:00100000:0.0:1787882570.263706:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:0.0:1787882570.263718:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541919488:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882570.263813:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1548380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541919488:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 98us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882570.263821:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:0.0:1787882570.263894:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:0.0:1787882570.263900:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1874730541919104:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787882570.263929:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e19aa4d4-406f-42d0-a5c3-03793bedba3c@192.168.206.21@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:0.0:1787882570.263988:0:5845:0:(genops.c:1385:class_connect()) connect: client e19aa4d4-406f-42d0-a5c3-03793bedba3c, cookie 0xf4731e8a7c5dee61 00000004:00100000:0.0:1787882570.264026:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787882570.264392:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9fa2c159e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787882570.264433:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:2355:x1874730541919104:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 531us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882570.264440:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00080000:2.0:1787882570.264641:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882570.268413:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882570.268539:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541919232 00000100:00100000:0.0:1787882570.268551:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541919232 00000100:00100000:0.0:1787882570.268640:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1787882570.268652:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:0:x1874730541919232:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787882570.268716:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1787882570.270398:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882570.271054:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:0:x1874730541919232:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 2391us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882570.271069:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:3.0:1787882570.272796:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882570.273677:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541919360 00000100:00100000:0.0:1787882570.273693:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541919360 00000100:00100000:0.0:1787882570.273781:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:0.0:1787882570.273794:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:8159:x1874730541919360:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787882570.273902:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787882570.274015:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:8159:x1874730541919360:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 223us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882570.274023:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1787882570.276448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882570.276553:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541919616 00000100:00100000:1.0:1787882570.276565:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541919616 00000100:00100000:1.0:1787882570.276634:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:1.0:1787882570.276646:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:8159:x1874730541919616:12345-192.168.206.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787882570.276754:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1548a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:8159:x1874730541919616:12345-192.168.206.21@tcp:40:mount.lustre.0 Request processed in 110us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882570.276763:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:1.0:1787882570.281478:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882570.281574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882570.281695:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541919744 00000100:00100000:3.0:1787882570.281708:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541919744 00000100:00100000:3.0:1787882570.281764:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541919872 00000100:00100000:3.0:1787882570.281767:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541919872 00000100:00100000:3.0:1787882570.281801:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1787882570.281811:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874730541919744:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787882570.281852:0:6710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e19aa4d4-406f-42d0-a5c3-03793bedba3c@192.168.206.21@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:3.0:1787882570.281936:0:6710:0:(genops.c:1385:class_connect()) connect: client e19aa4d4-406f-42d0-a5c3-03793bedba3c, cookie 0xf4731e8a7c5dee68 00002000:00100000:3.0:1787882570.281951:0:6710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e19aa4d4-406f-42d0-a5c3-03793bedba3c/ffff9fa2a04db800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787882570.281981:0:6710:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787882570.282405:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:2.0:1787882570.282414:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874730541919872:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787882570.282435:0:6711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e19aa4d4-406f-42d0-a5c3-03793bedba3c@192.168.206.21@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:2.0:1787882570.282459:0:6711:0:(genops.c:1385:class_connect()) connect: client e19aa4d4-406f-42d0-a5c3-03793bedba3c, cookie 0xf4731e8a7c5dee6f 00002000:00100000:2.0:1787882570.282465:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e19aa4d4-406f-42d0-a5c3-03793bedba3c/ffff9fa2af174800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787882570.282473:0:6711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787882570.282657:0:6711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787882570.282699:0:6711:0:(import.c:65:import_set_state_nolock()) ffff9fa2af173000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787882570.282804:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:2355:x1874730541919872:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 389us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882570.282813:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00002000:00080000:3.0:1787882570.283164:0:6710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787882570.283185:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9fa2a04dc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787882570.283230:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:2355:x1874730541919744:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 1419us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882570.283237:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:1.0:1787882570.289012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882570.289267:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541920000 00000100:00100000:2.0:1787882570.289282:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541920000 00000100:00100000:2.0:1787882570.289357:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:2.0:1787882570.289370:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:8159:x1874730541920000:12345-192.168.206.21@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787882570.289794:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787882570.290429:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:8159:x1874730541920000:12345-192.168.206.21@tcp:33:mount.lustre.0 Request processed in 1056us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882570.290441:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00010000:00010000:0.0:1787882570.858414:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882571.893567:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787882572.673941:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e19aa4d4-406f-42d0-a5c3-03793bedba3c 00010000:00010000:0.0:1787882572.906232:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787882573.174673:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e19aa4d4-406f-42d0-a5c3-03793bedba3c 00010000:00010000:3.0:1787882573.934299:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882574.122074:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787882574.122107:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563972096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882574.122217:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882574.122384:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563972096 00000100:00100000:1.0:1787882574.122395:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563972096 00000100:00100000:1.0:1787882574.122476:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787882574.122488:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563972096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882574.122537:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882574.122597:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563972096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882574.122605:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787882574.122653:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2a998e680 x1874730563972096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882574.122674:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563972096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787882574.123098:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882574.124621:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563972352:0@lo:400:kworker.0 00000100:00100000:2.0:1787882574.124710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882574.124751:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787882574.124757:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563972480:0@lo:400:kworker.0 00000100:00100000:2.0:1787882574.124782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882574.124822:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563972352 00000100:00100000:2.0:1787882574.124830:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563972352 00000100:00100000:2.0:1787882574.124905:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563972480 00000100:00100000:2.0:1787882574.124909:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563972480 00000100:00100000:2.0:1787882574.124944:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787882574.124953:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563972352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882574.125006:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563972352:12345-0@lo:400:kworker.0 Request processed in 53us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882574.125014:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787882574.125050:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787882574.125056:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563972480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882574.125085:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563972480:12345-0@lo:400:kworker.0 Request processed in 30us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882574.125091:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787882574.125112:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882574.125145:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563972480:0@lo:400:kworker.0 00000100:00100000:2.0:1787882574.125157:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563972352:0@lo:400:kworker.0 00000100:00100000:3.0:1787882574.125260:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563972608:0@lo:400:kworker.0 00000100:00100000:3.0:1787882574.125297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882574.125324:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787882574.125330:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563972224:0@lo:400:kworker.0 00000100:00100000:3.0:1787882574.125360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882574.125394:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563972736:0@lo:400:kworker.0 00000100:00100000:3.0:1787882574.125420:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882574.125450:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563972224 00000100:00100000:3.0:1787882574.125454:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563972224 00000100:00100000:3.0:1787882574.125487:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787882574.125494:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563972224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882574.125528:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563972224:12345-0@lo:400:kworker.0 Request processed in 35us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882574.125535:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787882574.125570:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563972736 00000100:00100000:3.0:1787882574.125574:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563972736 00000100:00100000:3.0:1787882574.125607:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787882574.125614:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563972736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882574.125659:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1548700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563972736:12345-0@lo:400:kworker.0 Request processed in 46us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882574.125666:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787882574.125696:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563972224:0@lo:400:kworker.0 00010000:00080000:3.0:1787882574.125709:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b986ea00 x1874730563972736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882574.125720:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563972736:0@lo:400:kworker.0 00000100:00080000:3.0:1787882574.125739:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787882574.125894:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563972608 00000100:00100000:2.0:1787882574.125899:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563972608 00000100:00100000:2.0:1787882574.125936:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787882574.125943:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563972608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882574.125980:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563972608:12345-0@lo:400:kworker.0 Request processed in 37us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882574.125986:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787882574.126066:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563972608:0@lo:400:kworker.0 00000100:00080000:3.0:1787882574.126084:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882574.634404:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787882574.634438:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563972864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882574.634538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882574.634615:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563972864 00000100:00100000:0.0:1787882574.634629:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563972864 00000100:00100000:0.0:1787882574.634699:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787882574.634712:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563972864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787882574.634757:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882574.634814:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563972864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882574.634823:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787882574.635053:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2a998e680 x1874730563972864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882574.635089:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563972864:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787882574.735030:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e19aa4d4-406f-42d0-a5c3-03793bedba3c 00010000:00010000:0.0:1787882574.955603:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882575.521709:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882575.521770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882575.522353:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882575.522392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882575.522430:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882575.522440:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541920384 00000100:00100000:1.0:1787882575.522453:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541920256 00000100:00100000:0.0:1787882575.522453:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541920384 00000100:00100000:1.0:1787882575.522456:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541920256 00000100:00100000:2.0:1787882575.522525:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541920128 00000100:00100000:2.0:1787882575.522531:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541920128 00000100:00100000:1.0:1787882575.522531:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:1.0:1787882575.522542:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541920256:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882575.522560:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 222 00000100:00100000:2.0:1787882575.522567:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2358:x1874730541920128:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882575.522635:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541920640 00000100:00100000:1.0:1787882575.522637:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541920256:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882575.522639:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541920640 00000100:00100000:1.0:1787882575.522646:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:1.0:1787882575.522686:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541920512 00000100:00100000:1.0:1787882575.522709:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541920512 00000100:00100000:0.0:1787882575.531596:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00100000:0.0:1787882575.531621:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541920384:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882575.532837:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:1.0:1787882575.532879:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541920512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882575.536073:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:3.0:1787882575.536093:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541920640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882575.536189:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541920640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 102us (13837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882575.536220:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:2.0:1787882575.536263:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2358:x1874730541920128:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 13693us (14568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882575.536277:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 222 00000100:00080000:2.0:1787882575.537821:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787882575.537834:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787882575.537838:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882575.539255:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541920512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 6378us (16808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882575.539273:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:0.0:1787882575.539704:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541920384:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 8089us (17931us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882575.539716:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 71 00010000:00010000:0.0:1787882575.982015:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787882576.100184:0:10330:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787882577.005409:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882578.026403:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882579.051119:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882579.242128:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563972992:0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.242248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882579.242315:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563973504:0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.242344:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882579.242373:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787882579.242378:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563973376:0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.242401:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882579.242429:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563973120:0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.242451:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882579.242467:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563973632:0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.242508:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882579.242526:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787882579.242532:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563973248:0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.242554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882579.242594:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563972992 00000100:00100000:2.0:1787882579.242603:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563972992 00000100:00100000:2.0:1787882579.242659:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787882579.242670:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563972992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.242729:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563972992:12345-0@lo:400:kworker.0 Request processed in 59us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882579.242737:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787882579.242780:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563973504 00000100:00100000:2.0:1787882579.242784:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563973504 00000100:00100000:2.0:1787882579.242818:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563973120 00000100:00100000:2.0:1787882579.242822:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563973120 00000100:00100000:2.0:1787882579.242833:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563973248 00000100:00100000:2.0:1787882579.242836:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563973248 00000100:00100000:2.0:1787882579.242849:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787882579.242864:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563973504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.242922:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563973504:12345-0@lo:400:kworker.0 Request processed in 59us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882579.242928:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787882579.242943:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787882579.242949:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563973120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.242981:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563973120:12345-0@lo:400:kworker.0 Request processed in 31us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882579.242987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787882579.243002:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787882579.243008:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563973248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.243034:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563973248:12345-0@lo:400:kworker.0 Request processed in 27us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882579.243041:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787882579.243060:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563973376 00000100:00100000:2.0:1787882579.243065:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563973376 00000100:00100000:2.0:1787882579.243094:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563973632 00000100:00100000:2.0:1787882579.243097:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563973632 00000100:00100000:2.0:1787882579.243120:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787882579.243126:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563973376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882579.243220:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563973760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882579.243265:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882579.243299:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563973760 00000100:00100000:0.0:1787882579.243303:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563973760 00000100:00100000:0.0:1787882579.243338:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787882579.243345:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730563973760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882579.243378:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882579.243419:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730563973760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882579.243425:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787882579.243470:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29da97800 x1874730563973760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882595 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882579.243491:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563973760:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787882579.243544:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787882579.243549:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787882579.243552:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882579.243710:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787882579.243722:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563973632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882579.243762:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563973632:12345-0@lo:400:kworker.0 Request processed in 44us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882579.243775:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787882579.244496:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563973376:12345-0@lo:400:kworker.0 Request processed in 1368us (2092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882579.244511:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787882579.244556:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563973248:0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.244573:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563973120:0@lo:400:kworker.0 00010000:00080000:2.0:1787882579.244604:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b986df80 x1874730563973632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882579.244615:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563973632:0@lo:400:kworker.0 00010000:00080000:0.0:1787882579.244645:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b986c380 x1874730563973376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882579.244656:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563973376:0@lo:400:kworker.0 00000100:00100000:0.0:1787882579.244667:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563972992:0@lo:400:kworker.0 00000100:00100000:0.0:1787882579.244679:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563973504:0@lo:400:kworker.0 00000100:00100000:2.0:1787882579.754357:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563973888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787882579.754478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882579.754614:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563973888 00000100:00100000:0.0:1787882579.754625:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563973888 00000100:00100000:0.0:1787882579.754691:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787882579.754703:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563973888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787882579.754747:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882579.761949:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563973888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7233us (7457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882579.761966:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787882579.768489:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1549180 x1874730563973888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882595 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882579.768527:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563973888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787882580.074568:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882580.644133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882580.644213:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882580.644250:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882580.644280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882580.644310:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882580.644349:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541921152 00000100:00100000:0.0:1787882580.644361:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541921152 00000100:00100000:0.0:1787882580.644434:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541921280 00000100:00100000:0.0:1787882580.644438:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541921280 00000100:00100000:0.0:1787882580.644467:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:0.0:1787882580.644479:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2356:x1874730541921152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882580.644573:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2356:x1874730541921152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 95us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882580.644581:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:0.0:1787882580.644608:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:0.0:1787882580.644615:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541921280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882580.644644:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541921280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882580.644650:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:0.0:1787882580.644671:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541920896 00000100:00100000:0.0:1787882580.644675:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541920896 00000100:00100000:0.0:1787882580.644703:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541921024 00000100:00100000:0.0:1787882580.644706:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541921024 00000100:00100000:0.0:1787882580.644727:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:0.0:1787882580.644752:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541920896:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882580.644781:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541920896:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882580.644788:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:0.0:1787882580.644800:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:0.0:1787882580.644806:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541921024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882580.644830:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541921024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882580.644835:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00080000:0.0:1787882580.644857:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787882580.644862:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787882580.644864:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787882580.645017:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541920768 00000100:00100000:3.0:1787882580.645023:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541920768 00000100:00100000:3.0:1787882580.645064:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 224 00000100:00100000:3.0:1787882580.645072:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541920768:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882580.645102:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541920768:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882580.645109:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 224 00010000:00010000:0.0:1787882581.098248:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882582.122176:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882583.147848:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882584.172092:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882584.362359:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563974400:0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.362431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882584.362487:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787882584.362493:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563974016:0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.362521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882584.362543:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563974528:0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.362566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882584.362590:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563974144:0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.362610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882584.362626:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563974656:0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.362645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882584.362662:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787882584.362667:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563974272:0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.362686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882584.362725:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563974400 00000100:00100000:2.0:1787882584.362731:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563974400 00000100:00100000:0.0:1787882584.365486:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787882584.365512:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563974784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882584.365583:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882584.365654:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563974784 00000100:00100000:0.0:1787882584.365662:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563974784 00000100:00100000:0.0:1787882584.365711:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787882584.365720:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730563974784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882584.365756:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882584.365801:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730563974784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882584.365807:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787882584.365896:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af848e00 x1874730563974784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882600 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882584.365927:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563974784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882584.369565:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563974656 00000100:00100000:2.0:1787882584.369576:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563974656 00000100:00100000:2.0:1787882584.369624:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787882584.369634:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563974400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.369723:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563974400:12345-0@lo:400:kworker.0 Request processed in 91us (7292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882584.369730:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787882584.369752:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787882584.369758:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563974656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.369808:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563974656:12345-0@lo:400:kworker.0 Request processed in 50us (7161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882584.369814:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787882584.369838:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563974016 00000100:00100000:2.0:1787882584.369842:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563974016 00000100:00100000:2.0:1787882584.369889:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787882584.369896:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563974016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.369931:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563974016:12345-0@lo:400:kworker.0 Request processed in 36us (7409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882584.369938:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787882584.369971:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563974528 00000100:00100000:2.0:1787882584.369975:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563974528 00000100:00100000:2.0:1787882584.370001:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563974144 00000100:00100000:2.0:1787882584.370004:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563974144 00000100:00100000:2.0:1787882584.370140:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563974272 00000100:00100000:2.0:1787882584.370145:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563974272 00000100:00100000:2.0:1787882584.370168:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787882584.370175:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563974528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.370220:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563974528:12345-0@lo:400:kworker.0 Request processed in 45us (7652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882584.370227:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787882584.370240:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787882584.370246:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563974144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.370273:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563974144:12345-0@lo:400:kworker.0 Request processed in 27us (7662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882584.370278:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787882584.370290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787882584.370295:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563974272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.370320:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563974272:12345-0@lo:400:kworker.0 Request processed in 25us (7633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882584.370325:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1787882584.370352:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787882584.370357:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787882584.370358:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882584.370398:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563974016:0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.370412:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563974528:0@lo:400:kworker.0 00010000:00080000:2.0:1787882584.370426:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b986ed80 x1874730563974400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882584.370436:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563974400:0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.370470:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563974272:0@lo:400:kworker.0 00000100:00100000:2.0:1787882584.370480:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563974144:0@lo:400:kworker.0 00010000:00080000:2.0:1787882584.370500:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b986e300 x1874730563974656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882584.370509:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563974656:0@lo:400:kworker.0 00000100:00100000:1.0:1787882584.875424:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787882584.875449:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563974912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787882584.875523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882584.875648:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563974912 00000100:00100000:0.0:1787882584.875656:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563974912 00000100:00100000:0.0:1787882584.875707:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787882584.875716:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563974912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787882584.875750:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882584.875796:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563974912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882584.875804:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787882584.875978:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1549180 x1874730563974912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882600 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882584.876006:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563974912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787882585.195225:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882585.766236:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882585.766280:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882585.766311:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882585.766333:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882585.766356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882585.766384:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541921536 00000100:00100000:3.0:1787882585.766395:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541921536 00000100:00100000:3.0:1787882585.766470:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541921664 00000100:00100000:3.0:1787882585.766474:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541921664 00000100:00100000:3.0:1787882585.766500:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:3.0:1787882585.766510:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541921536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882585.766592:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541921536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882585.766614:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:3.0:1787882585.766636:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:3.0:1787882585.766642:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541921664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882585.766667:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541921664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882585.766673:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:3.0:1787882585.766691:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541921792 00000100:00100000:3.0:1787882585.766694:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541921792 00000100:00100000:3.0:1787882585.766718:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541921920 00000100:00100000:3.0:1787882585.766721:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541921920 00000100:00100000:3.0:1787882585.766743:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:3.0:1787882585.766749:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541921792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882585.766773:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541921792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882585.766780:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:3.0:1787882585.766792:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:3.0:1787882585.766799:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541921920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882585.766823:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541921920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882585.766829:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:3.0:1787882585.766846:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541921408 00000100:00100000:3.0:1787882585.766849:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541921408 00000100:00100000:3.0:1787882585.766904:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 226 00000100:00100000:3.0:1787882585.766911:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541921408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882585.766944:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541921408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882585.766951:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 226 00000100:00080000:3.0:1787882585.766982:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787882585.766986:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787882585.766989:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787882586.229066:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882587.244083:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882588.268319:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882589.300482:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882589.487070:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787882589.487110:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563975040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882589.487199:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882589.487280:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563975040 00000100:00100000:0.0:1787882589.487290:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563975040 00000100:00100000:0.0:1787882589.487359:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787882589.487371:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563975040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882589.487415:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882589.487466:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563975040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882589.487474:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787882589.487538:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af848e00 x1874730563975040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882589.487583:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563975040:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787882589.487655:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787882589.487903:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563975296:0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.487945:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882589.487970:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787882589.487977:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563975168:0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488008:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882589.488034:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563975680:0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488059:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882589.488089:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563975168 00000100:00100000:3.0:1787882589.488093:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563975168 00000100:00100000:3.0:1787882589.488139:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787882589.488147:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563975168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488187:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563975168:12345-0@lo:400:kworker.0 Request processed in 41us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882589.488194:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787882589.488228:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563975680 00000100:00100000:3.0:1787882589.488232:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563975680 00000100:00100000:3.0:1787882589.488268:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787882589.488275:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563975680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488321:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563975680:12345-0@lo:400:kworker.0 Request processed in 47us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882589.488328:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787882589.488355:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563975552:0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882589.488403:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787882589.488409:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563975424:0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882589.488458:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563975296 00000100:00100000:3.0:1787882589.488462:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563975296 00000100:00100000:3.0:1787882589.488487:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563975552 00000100:00100000:3.0:1787882589.488490:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563975552 00000100:00100000:3.0:1787882589.488504:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563975424 00000100:00100000:3.0:1787882589.488507:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563975424 00000100:00100000:3.0:1787882589.488521:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787882589.488527:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563975296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488560:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563975296:12345-0@lo:400:kworker.0 Request processed in 33us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882589.488567:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787882589.488579:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787882589.488585:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563975552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488614:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563975552:12345-0@lo:400:kworker.0 Request processed in 29us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882589.488619:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787882589.488630:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787882589.488637:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563975424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488674:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563975424:12345-0@lo:400:kworker.0 Request processed in 36us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882589.488680:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787882589.488704:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787882589.488708:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882589.488729:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563975424:0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488740:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563975552:0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488769:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563975168:0@lo:400:kworker.0 00010000:00080000:3.0:1787882589.488781:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2a998df80 x1874730563975680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882589.488791:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563975680:0@lo:400:kworker.0 00000100:00100000:3.0:1787882589.488801:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563975296:0@lo:400:kworker.0 00000100:00100000:1.0:1787882589.994786:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787882589.994826:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563975808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787882589.994950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882589.994991:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563975808 00000100:00100000:0.0:1787882589.995003:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563975808 00000100:00100000:0.0:1787882589.995077:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787882589.995090:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563975808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787882589.995256:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882589.995322:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563975808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 233us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882589.995330:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787882589.995940:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9cad80 x1874730563975808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882589.995978:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563975808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787882590.314129:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882590.886665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882590.886715:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882590.886755:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882590.886794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882590.886899:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882590.886908:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541922304 00000100:00100000:1.0:1787882590.886920:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541922304 00000100:00100000:2.0:1787882590.886931:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541922048 00000100:00100000:2.0:1787882590.886934:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541922048 00000100:00100000:1.0:1787882590.886985:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541922176 00000100:00100000:1.0:1787882590.886988:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541922176 00000100:00100000:2.0:1787882590.886989:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 228 00000100:00100000:2.0:1787882590.887000:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541922048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882590.887009:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:1.0:1787882590.887016:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2359:x1874730541922304:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882590.887104:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541922048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 105us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882590.887112:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 228 00000100:00100000:2.0:1787882590.887165:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541922432 00000100:00100000:2.0:1787882590.887169:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541922432 00000100:00100000:2.0:1787882590.887196:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541922560 00000100:00100000:2.0:1787882590.887200:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541922560 00000100:00100000:2.0:1787882590.887225:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:2.0:1787882590.887232:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa298adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2355:x1874730541922432:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:2.0:1787882590.887256:0:6710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dee68 00000100:00080000:2.0:1787882590.887267:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9fa2a04dc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787882590.887315:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787882590.887472:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2359:x1874730541922304:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 455us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882590.887480:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:1.0:1787882590.887496:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:1.0:1787882590.887504:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541922176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882590.887529:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541922176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882590.887536:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00080000:1.0:1787882590.887553:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882590.887558:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787882590.887562:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882590.888569:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa298adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+2:2355:x1874730541922432:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 1327us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882590.888600:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:2.0:1787882590.888833:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:2.0:1787882590.888845:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2355:x1874730541922560:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:2.0:1787882590.889231:0:6710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dee6f 00000100:00080000:2.0:1787882590.889243:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9fa2af173000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787882590.889296:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1787882590.889388:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882590.889560:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+2:2355:x1874730541922560:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 716us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882590.889570:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00010000:00010000:2.0:1787882590.890265:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882591.340779:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882592.365162:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787882593.301606:0:11031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787882593.387063:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787882593.631249:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e19aa4d4-406f-42d0-a5c3-03793bedba3c 00000020:00000080:2.0:1787882593.631262:0:7664:0:(genops.c:885:class_export_put()) final put ffff9fa2af174800/e19aa4d4-406f-42d0-a5c3-03793bedba3c 00000020:00000080:1.0:1787882593.631403:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2af174800/e19aa4d4-406f-42d0-a5c3-03793bedba3c for lustre-OST0001 00000020:00000080:1.0:1787882593.631471:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2af173000 for lustre-OST0001 00010000:00010000:2.0:1787882594.410479:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882594.602166:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563975936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882594.602256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882594.602430:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563975936 00000100:00100000:0.0:1787882594.602441:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563975936 00000100:00100000:0.0:1787882594.602516:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787882594.602526:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563975936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882594.602569:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882594.602621:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563975936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882594.602629:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787882594.602685:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787882594.602753:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2af848e00 x1874730563975936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882594.602773:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563975936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882594.604850:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563976064:0@lo:400:kworker.0 00000100:00100000:3.0:1787882594.605098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882594.605149:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563976576:0@lo:400:kworker.0 00000100:00100000:3.0:1787882594.605180:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882594.605209:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787882594.605216:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563976448:0@lo:400:kworker.0 00000100:00100000:3.0:1787882594.605242:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882594.605275:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563976064 00000100:00100000:3.0:1787882594.605282:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563976064 00000100:00100000:3.0:1787882594.605340:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787882594.605350:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563976064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882594.605430:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563976064:12345-0@lo:400:kworker.0 Request processed in 81us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882594.605439:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787882594.605481:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563976576 00000100:00100000:3.0:1787882594.605485:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563976576 00000100:00100000:3.0:1787882594.605527:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787882594.605533:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563976576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882594.605569:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563976576:12345-0@lo:400:kworker.0 Request processed in 37us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882594.605576:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787882594.605598:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882594.605626:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563976064:0@lo:400:kworker.0 00010000:00080000:3.0:1787882594.605642:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d8a1f80 x1874730563976576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882594.605655:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563976576:0@lo:400:kworker.0 00000100:00100000:0.0:1787882594.606177:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563976320:0@lo:400:kworker.0 00000100:00100000:0.0:1787882594.606222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882594.606249:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787882594.606256:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563976192:0@lo:400:kworker.0 00000100:00100000:0.0:1787882594.606278:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882594.606386:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563976448 00000100:00100000:1.0:1787882594.606394:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563976448 00000100:00100000:1.0:1787882594.606445:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563976320 00000100:00100000:1.0:1787882594.606448:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563976320 00000100:00100000:1.0:1787882594.606464:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563976192 00000100:00100000:1.0:1787882594.606467:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563976192 00000100:00100000:1.0:1787882594.606482:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787882594.606490:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563976448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882594.606538:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563976448:12345-0@lo:400:kworker.0 Request processed in 50us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882594.606545:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787882594.606559:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787882594.606578:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563976320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882594.606611:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563976320:12345-0@lo:400:kworker.0 Request processed in 35us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882594.606617:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787882594.606628:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787882594.606633:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563976192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882594.606658:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730563976192:12345-0@lo:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882594.606664:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787882594.606704:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af84bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730563976192:0@lo:400:kworker.0 00000100:00100000:1.0:1787882594.606714:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563976320:0@lo:400:kworker.0 00000100:00080000:0.0:1787882594.609100:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882594.609281:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563976448:0@lo:400:kworker.0 00000100:00100000:3.0:1787882595.116086:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563976704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882595.116186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882595.116262:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563976704 00000100:00100000:1.0:1787882595.116274:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563976704 00000100:00100000:1.0:1787882595.116346:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787882595.116359:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563976704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882595.116410:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882595.116472:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563976704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882595.116481:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787882595.117787:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d9c8000 x1874730563976704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882595.117817:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563976704:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1787882595.249236:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e19aa4d4-406f-42d0-a5c3-03793bedba3c 00000020:00000080:1.0:1787882595.249250:0:6737:0:(genops.c:885:class_export_put()) final put ffff9fa2a04db800/e19aa4d4-406f-42d0-a5c3-03793bedba3c 00000020:00000080:2.0:1787882595.251642:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2a04db800/e19aa4d4-406f-42d0-a5c3-03793bedba3c for lustre-OST0000 00000020:00000080:3.0:1787882595.258748:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2a04dc000 for lustre-OST0000 00010000:00010000:1.0:1787882595.437131:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882596.003443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882596.003501:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882596.003553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882596.003591:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541922816 00000100:00100000:1.0:1787882596.003604:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541922816 00000100:00100000:1.0:1787882596.003672:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541922944 00000100:00100000:1.0:1787882596.003675:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541922944 00000100:00100000:1.0:1787882596.003702:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 90 00000100:00100000:1.0:1787882596.003713:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541922816:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882596.003806:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541922816:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 94us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882596.003815:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 90 00000100:00100000:1.0:1787882596.003848:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 91 00000100:00100000:1.0:1787882596.003855:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2356:x1874730541922944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882596.003911:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2356:x1874730541922944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 57us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882596.003917:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 91 00000100:00100000:0.0:1787882596.004215:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541922688 00000100:00100000:0.0:1787882596.004221:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541922688 00000100:00100000:0.0:1787882596.004266:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 230 00000100:00100000:0.0:1787882596.004275:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2356:x1874730541922688:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882596.004307:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2356:x1874730541922688:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882596.004313:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 230 00000100:00080000:0.0:1787882596.004384:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787882596.469850:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787882596.637500:0:11179:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff7a99c390 20000000:00000080:3.0:1787882596.637517:0:11179:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa2a0423000 uarg=0000000000000000 20000000:01000000:3.0:1787882596.637554:0:11179:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787882596.637567:0:11179:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787882596.637572:0:11179:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787882596.642157:0:11180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787882596.642316:0:11179:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787882596.653819:0:11179:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787882596.653981:0:11179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654000:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5dee22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee1b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654007:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5dee30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee29 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654015:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dee37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f5f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654039:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5dee45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee3e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654045:0:11179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5dee5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f97 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654052:0:11179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654109:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5dee5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f97 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654123:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5dee5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f97 expref: 12 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882596.654138:0:11179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1874730563976832:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882596.654241:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5dee45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dee3e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654250:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5dee45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee3e expref: 18 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882596.654260:0:11179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1874730563976960:0@lo:104: 00000100:00100000:1.0:1787882596.654300:0:11179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787882596.654342:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dee37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f5f expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654350:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dee37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f5f expref: 12 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882596.654366:0:11179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1874730563977088:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882596.654396:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5dee30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dee29 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654404:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5dee30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee29 expref: 18 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882596.654411:0:11179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1874730563977216:0@lo:104: 00000100:00100000:1.0:1787882596.654434:0:11179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882596.654463:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563976960 00000100:00100000:1.0:1787882596.654471:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563976960 00000100:00100000:1.0:1787882596.654509:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563977216 00000100:00100000:1.0:1787882596.654512:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563977216 00000100:00100000:1.0:1787882596.654526:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787882596.654536:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:11179:x1874730563976960:12345-0@lo:104: 00010000:00010000:1.0:1787882596.654549:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.654592:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787882596.654598:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:11179:x1874730563976960:12345-0@lo:104: Request processed in 64us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882596.654604:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787882596.656046:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787882596.656070:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:11179:x1874730563977216:12345-0@lo:104: 00010000:00010000:1.0:1787882596.656083:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656155:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787882596.656160:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:11179:x1874730563977216:12345-0@lo:104: Request processed in 105us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882596.656167:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787882596.656191:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787882596.656197:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656204:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031600 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882596.656209:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656217:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882596.656224:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882596.656230:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787882596.656259:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656265:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882596.656280:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656287:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280031600/0xf4731e8a7c5dee3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee45 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656310:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882596.656313:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656319:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813fee00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882596.656321:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656328:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882596.656335:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882596.656340:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787882596.656351:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656356:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882596.656368:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656375:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2813fee00/0xf4731e8a7c5dee29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee30 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656384:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882596.656386:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882596.656387:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882596.656408:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563977472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787882596.656444:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787882596.656504:0:11179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5dee22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dee1b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656515:0:11179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5dee22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee1b expref: 18 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882596.656525:0:11179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1874730563977600:0@lo:104: 00000100:00100000:1.0:1787882596.656548:0:11179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882596.656567:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563977600 00000100:00100000:1.0:1787882596.656572:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563977600 00000100:00100000:1.0:1787882596.656592:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787882596.656597:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:11179:x1874730563977600:12345-0@lo:104: 00010000:00010000:1.0:1787882596.656604:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656629:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787882596.656634:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:11179:x1874730563977600:12345-0@lo:104: Request processed in 37us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882596.656640:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787882596.656650:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882596.656654:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656660:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cee00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882596.656663:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656670:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882596.656681:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882596.656687:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787882596.656713:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656719:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882596.656727:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656734:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cee00/0xf4731e8a7c5dee1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee22 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.656747:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882596.656749:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882596.656750:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882596.656761:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563977728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787882596.656783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882596.656809:0:11179:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298a17c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787882596.656842:0:11179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1874730563976960:0@lo:104: 00000100:00100000:1.0:1787882596.656852:0:11179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1874730563977216:0@lo:104: 00000100:00100000:1.0:1787882596.656859:0:11179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1874730563977600:0@lo:104: 00010000:00010000:3.0:1787882596.656973:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882596.656985:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563977344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882596.657013:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882596.657072:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563977472 00000100:00100000:3.0:1787882596.657076:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563977472 00010000:00010000:3.0:1787882596.657095:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5dee30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee29 expref: 19 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882596.657116:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563977728 00000100:00100000:3.0:1787882596.657119:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563977728 00010000:00010000:3.0:1787882596.657130:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5dee22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee1b expref: 20 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882596.657139:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563977344 00000100:00100000:3.0:1787882596.657141:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563977344 00010000:00010000:3.0:1787882596.657148:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5dee45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee3e expref: 21 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882596.657158:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787882596.657164:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286602450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+21:3305:x1874730563977472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882596.657173:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882596.657177:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5dee30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee29 expref: 21 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.657186:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5dee30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee29 expref: 21 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.657198:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5dee30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dee29 expref: 21 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.657217:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882596.657244:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286602450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+20:3305:x1874730563977472:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882596.657250:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787882596.657299:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787882596.657305:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563977728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882596.657311:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882596.657314:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5dee22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee1b expref: 19 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.657323:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5dee22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee1b expref: 19 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.657332:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031000/0xf4731e8a7c5dee22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dee1b expref: 19 pid: 5837 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.657340:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882596.657366:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:3306:x1874730563977728:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882596.657372:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787882596.657384:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787882596.657390:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:3308:x1874730563977344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882596.657397:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882596.657401:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5dee45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee3e expref: 17 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.657409:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5dee45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee3e expref: 17 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.657426:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fe800/0xf4731e8a7c5dee45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dee3e expref: 17 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.657435:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882596.657462:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3308:x1874730563977344:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882596.657468:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787882596.657513:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563977472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882596.657538:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563977728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882596.657555:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563977344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882596.661142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882596.661173:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882596.661198:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541923072 00000100:00100000:3.0:1787882596.661206:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541923072 00010000:00010000:3.0:1787882596.661241:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5dee5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f97 expref: 13 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882596.661268:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541923200 00000100:00100000:3.0:1787882596.661271:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541923200 00010000:00010000:3.0:1787882596.661282:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dee37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f5f expref: 14 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882596.661296:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:3.0:1787882596.661305:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+14:2356:x1874730541923072:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882596.661318:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882596.661323:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5dee5a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f97 expref: 14 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661349:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5dee5a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f97 expref: 14 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661368:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882596.661415:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+14:2356:x1874730541923072:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 110us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882596.661423:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:3.0:1787882596.661446:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:3.0:1787882596.661453:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2356:x1874730541923200:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882596.661460:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882596.661464:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dee37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f5f expref: 13 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661472:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dee37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f5f expref: 13 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661483:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661491:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661505:0:8466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661513:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661520:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661534:0:8466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661540:0:8466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813fe200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882596.661544:0:8466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661552:0:8466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661561:0:8466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882596.661572:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882596.661594:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2356:x1874730541923200:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 141us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882596.661601:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00010000:00010000:1.0:1787882596.661768:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5dee5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f97 expref: 12 pid: 5835 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882596.661781:0:11179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1874730563976832:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882596.661802:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dee37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f5f expref: 11 pid: 5838 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882596.661811:0:11179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11179:1874730563977088:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882596.661910:0:11179:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.661921:0:11179:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.661926:0:11179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882596.661932:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee76 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882597.482975:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882598.506015:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787882598.506137:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787882598.506145:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2c174b000 from 7 10000000:01000000:2.0:1787882598.506152:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787882598.506213:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882598.506238:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882598.506254:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882598.506288:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563977856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787882598.506383:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882598.506459:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563977856 00000100:00100000:2.0:1787882598.506465:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787882598.506473:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563977856 00000100:00100000:1.0:1787882598.506541:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787882598.506554:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563977856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882598.506570:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882598.506590:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5dee84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dee7d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.506629:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5dee84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee7d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.506640:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5dee84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee7d expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.506658:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813fee00, rc 0) 00000100:00100000:1.0:1787882598.506724:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563977856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882598.506731:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787882598.508128:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563977856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787882598.508161:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882598.508175:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882598.508276:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563977984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882598.508344:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882598.508396:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787882598.508734:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563977984 00000100:00100000:1.0:1787882598.508748:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563977984 00000100:00100000:1.0:1787882598.508812:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787882598.508834:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563977984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882598.509295:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563977984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 472us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882598.509303:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787882598.510097:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563977984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882598.510175:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882598.510257:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882598.510313:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787882598.510969:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563978112 00000100:00100000:1.0:1787882598.510981:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563978112 00000100:00100000:1.0:1787882598.511039:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787882598.511058:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563978112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882598.511281:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563978112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882598.511289:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787882598.511336:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787882598.517056:0:11251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787882598.517387:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787882598.517416:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787882598.517427:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882598.517438:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882598.517447:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787882598.517450:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa29d82f000 from 7 10000000:01000000:2.0:1787882598.517452:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787882598.517488:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882598.517496:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882598.517506:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882598.517543:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787882598.517603:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882598.517649:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787882598.517739:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563978240 00000100:00100000:1.0:1787882598.517747:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563978240 00000100:00100000:1.0:1787882598.517799:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787882598.517809:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563978240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882598.518057:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882598.518071:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dee8b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.518101:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee8b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.518111:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee8b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.518120:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813fe200, rc 0) 00000100:00100000:1.0:1787882598.518170:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563978240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 363us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882598.518176:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787882598.518402:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882598.518415:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882598.518423:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882598.518468:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882598.518494:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882598.518664:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563978368 00000100:00100000:1.0:1787882598.518669:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563978368 00000100:00100000:0.0:1787882598.518705:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a02c79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882598.519387:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787882598.519399:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563978368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882598.523591:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563978368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4184us (5085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882598.523617:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787882598.523711:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882598.523764:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882598.523830:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882598.523863:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7155d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787882598.523903:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563978496 00000100:00100000:1.0:1787882598.523909:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563978496 00000100:00100000:1.0:1787882598.524140:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787882598.524148:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563978496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882598.524336:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563978496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882598.524343:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787882598.524386:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787882598.525233:0:11255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787882598.525290:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787882598.525312:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787882598.525322:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.525332:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882598.525342:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787882598.525344:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa285a97800 from 7 10000000:01000000:1.0:1787882598.525347:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787882598.525375:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.525383:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.525393:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882598.525411:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787882598.525455:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882598.525489:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7155c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787882598.525511:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563978624 00000100:00100000:1.0:1787882598.525517:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563978624 00000100:00100000:1.0:1787882598.525546:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787882598.525554:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563978624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882598.525564:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882598.525574:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5deea0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dee99 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.525595:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5deea0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee99 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.528688:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5deea0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee99 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.528707:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813ff800, rc 0) 00000100:00100000:1.0:1787882598.528781:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563978624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3226us (3324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882598.528790:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787882598.528861:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882598.528894:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.528905:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882598.528967:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882598.529000:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882598.529029:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7155c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787882598.529063:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563978752 00000100:00100000:1.0:1787882598.529069:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563978752 00000100:00100000:1.0:1787882598.529099:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787882598.529107:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563978752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882598.529338:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563978752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882598.529345:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787882598.529405:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882598.529436:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787882598.529473:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882598.529489:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a02c7240 going to sleep for 11 seconds 00000100:00100000:0.0:1787882598.529502:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563978880 00000100:00100000:0.0:1787882598.529505:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563978880 00000100:00100000:0.0:1787882598.529629:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787882598.529636:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563978880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787882598.530006:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563978880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 369us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882598.530013:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787882598.530064:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563978880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787882598.531479:0:11258:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787882598.531898:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787882598.531929:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787882598.531939:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882598.531950:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882598.561273:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882598.561394:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541923328 00000100:00100000:1.0:1787882598.561403:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541923328 00000100:00100000:1.0:1787882598.561458:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 240 00000100:00100000:1.0:1787882598.561470:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:5611:x1874730541923328:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882598.561485:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882598.561501:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5deea7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842fc1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.561528:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5deea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc1 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.561539:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5deea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc1 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882598.561549:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813fe000, rc 0) 00000100:00100000:1.0:1787882598.561609:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541923328:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 141us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882598.561617:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 240 00000100:00100000:3.0:1787882598.573328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882598.573401:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541923456 00000100:00100000:2.0:1787882598.573410:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541923456 00000100:00100000:2.0:1787882598.573461:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 241 00000100:00100000:2.0:1787882598.573472:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541923456:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882598.573732:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541923456:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 261us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882598.573740:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 241 00000100:00100000:0.0:1787882598.583435:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882598.584844:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541923584 00000100:00100000:2.0:1787882598.584856:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541923584 00000100:00100000:2.0:1787882598.584922:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 242 00000100:00100000:2.0:1787882598.584933:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541923584:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882598.585149:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541923584:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 217us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882598.585158:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 242 00000100:00100000:3.0:1787882598.599088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882598.599729:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541923712 00000100:00100000:0.0:1787882598.599739:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541923712 00000100:00100000:0.0:1787882598.599865:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 243 00000100:00100000:0.0:1787882598.599900:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541923712:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882598.599915:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882598.599933:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5deeae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842fc8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882598.599960:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5deeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc8 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882598.599971:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5deeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc8 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882598.599993:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9200, rc 0) 00000100:00100000:0.0:1787882598.600058:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:5611:x1874730541923712:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 152us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882598.600066:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 243 00000100:00100000:1.0:1787882598.604310:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882598.604642:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541923840 00000100:00100000:2.0:1787882598.604652:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541923840 00000100:00100000:2.0:1787882598.604703:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 244 00000100:00100000:2.0:1787882598.604713:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:5611:x1874730541923840:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882598.605135:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:5611:x1874730541923840:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 421us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882598.605231:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 244 00000100:00100000:3.0:1787882598.608293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882598.611505:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541923968 00000100:00100000:2.0:1787882598.611520:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541923968 00000100:00100000:2.0:1787882598.611582:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 245 00000100:00100000:2.0:1787882598.611593:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:5611:x1874730541923968:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882598.611800:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:5611:x1874730541923968:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 208us (3514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882598.611809:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 245 00010000:00010000:1.0:1787882599.531052:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882599.722067:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787882599.722091:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b986e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563979008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882599.722165:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882599.722957:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563979008 00000100:00100000:1.0:1787882599.722974:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563979008 00000100:00100000:1.0:1787882599.723038:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787882599.723059:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563979008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882599.723096:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882599.723164:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563979008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882599.723172:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787882599.723195:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787882599.723229:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2b986e680 x1874730563979008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882599.723253:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b986e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563979008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787882599.726320:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563979264:0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.726391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882599.726433:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787882599.726440:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563979392:0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.726463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882599.726511:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563979264 00000100:00100000:1.0:1787882599.726517:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563979264 00000100:00100000:1.0:1787882599.726559:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563979392 00000100:00100000:1.0:1787882599.726562:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563979392 00000100:00100000:1.0:1787882599.726591:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787882599.726599:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563979264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.726650:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563979264:12345-0@lo:400:kworker.0 Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882599.726658:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787882599.726675:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787882599.726681:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563979392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.726721:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563979392:12345-0@lo:400:kworker.0 Request processed in 40us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882599.726727:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787882599.726754:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563979520:0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.726779:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882599.726808:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787882599.726814:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563979136:0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.726842:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882599.726863:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563979648:0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.726915:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882599.726943:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563979136 00000100:00100000:1.0:1787882599.726947:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563979136 00000100:00100000:1.0:1787882599.726971:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787882599.726977:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563979136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.727009:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730563979136:12345-0@lo:400:kworker.0 Request processed in 32us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882599.727015:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787882599.727064:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563979648 00000100:00100000:1.0:1787882599.727068:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563979648 00000100:00100000:1.0:1787882599.727096:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787882599.728233:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563979520 00000100:00100000:2.0:1787882599.728253:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563979520 00000100:00100000:2.0:1787882599.728306:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787882599.728316:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563979520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882599.728376:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730563979520:12345-0@lo:400:kworker.0 Request processed in 62us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882599.728382:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787882599.729240:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563979648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.729293:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563979648:12345-0@lo:400:kworker.0 Request processed in 2190us (2376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882599.729300:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1787882599.729334:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882599.729340:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882599.729389:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730563979136:0@lo:400:kworker.0 00010000:00080000:1.0:1787882599.729408:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2bf48fb80 x1874730563979648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882599.729419:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563979648:0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.729430:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730563979520:0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.729470:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563979392:0@lo:400:kworker.0 00000100:00100000:1.0:1787882599.729482:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563979264:0@lo:400:kworker.0 00000001:02000400:0.0:1787882600.226714:0:11377:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787882600.235346:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563979776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787882600.235425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882600.235542:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563979776 00000100:00100000:1.0:1787882600.235550:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563979776 00000100:00100000:1.0:1787882600.235603:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787882600.235614:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563979776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882600.235646:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882600.235704:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563979776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882600.235711:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787882600.235787:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2bf48e680 x1874730563979776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882600.235805:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563979776:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787882600.554101:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882601.130512:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882601.130557:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882601.130595:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882601.130710:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541924096 00000100:00100000:3.0:1787882601.130722:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541924096 00000100:00100000:3.0:1787882601.130775:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 247 00000100:00100000:3.0:1787882601.130785:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541924096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882601.130866:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541924096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882601.130887:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541924224 00000100:00100000:0.0:1787882601.130893:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541924224 00000100:00100000:3.0:1787882601.130917:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 247 00000100:00100000:0.0:1787882601.130940:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541924352 00000100:00100000:0.0:1787882601.130944:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541924352 00000100:00100000:0.0:1787882601.130991:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00100000:0.0:1787882601.130999:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541924224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882601.131059:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541924224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 60us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882601.131062:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:0.0:1787882601.131074:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00100000:3.0:1787882601.131075:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541924352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882601.131102:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541924352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882601.131109:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00080000:1.0:1787882601.131533:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787882601.578103:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882602.602342:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882603.626177:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787882604.116773:0:11476:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:03:22 (1787882602) === 00000100:00100000:0.0:1787882604.296620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882604.296687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882604.296827:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541924480 00000100:00100000:1.0:1787882604.296842:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541924480 00000100:00100000:1.0:1787882604.296951:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:1.0:1787882604.296965:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541924480:12345-192.168.206.21@tcp:41:mkdir.0 00000004:00000024:1.0:1787882604.297032:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787882604.297184:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541924480:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 222us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882604.297192:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00080000:0.0:1787882604.297309:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882604.297374:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541924608 00000100:00100000:3.0:1787882604.297379:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541924608 00000100:00100000:3.0:1787882604.297418:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:3.0:1787882604.297427:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:9711:x1874730541924608:12345-192.168.206.21@tcp:700:mkdir.0 00000100:00100000:3.0:1787882604.297468:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:9711:x1874730541924608:12345-192.168.206.21@tcp:700:mkdir.0 Request processed in 44us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882604.297475:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:2.0:1787882604.304641:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882604.304837:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541924864 00000100:00100000:3.0:1787882604.304851:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541924864 00000100:00100000:3.0:1787882604.304961:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:3.0:1787882604.304975:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:9711:x1874730541924864:12345-192.168.206.21@tcp:36:mkdir.0 00010000:00010000:3.0:1787882604.305077:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882604.307004:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5ded96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f4a expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.307045:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00f00) 00010000:00010000:3.0:1787882604.307075:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787882604.307984:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5deeb5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.308013:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5deeb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.308037:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5deeb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.308079:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5deebc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.308087:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5deebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.308093:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5deebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882604.311074:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787882604.311093:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5deeb5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.311104:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5deeb5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.311111:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5deeb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.311116:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882604.311121:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5deeb5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.311623:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5deeb5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.311953:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727a00) 00010000:00010000:3.0:1787882604.311957:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882604.311964:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5deeb5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.311972:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5deeb5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787882604.312008:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003954a2a1 reply state 000000005e0c72b0 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5deebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882604.312029:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787882604.312221:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:9711:x1874730541924864:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 7245us (7594us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787882604.312231:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00010000:00010000:3.0:1787882604.316537:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5deebc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.316555:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5deebc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.316562:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5deebc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.316568:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882604.316572:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5deebc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.316579:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5deebc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.316614:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa2a0727d00) 00010000:00010000:3.0:1787882604.316617:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882604.316621:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5deebc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.316627:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5deebc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882604.329762:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882604.331494:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541924992 00000100:00100000:0.0:1787882604.331513:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541924992 00000100:00100000:0.0:1787882604.331595:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:0.0:1787882604.331607:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:9712:x1874730541924992:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1787882604.331634:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882604.331675:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5deec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842fcf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.331766:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deeca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.331782:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deeca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.331795:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deeca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882604.331885:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787882604.331890:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882604.331936:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deeca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.331966:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5deec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fcf expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.331988:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deeca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fcf expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.331997:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160100) 00010000:00010000:0.0:1787882604.332001:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787882604.332004:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8200, rc 0) 00000100:00100000:0.0:1787882604.332088:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:9712:x1874730541924992:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 483us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882604.332095:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:2.0:1787882604.338280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882604.338336:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541925248 00000100:00100000:2.0:1787882604.338348:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541925248 00000100:00100000:2.0:1787882604.338429:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:2.0:1787882604.338443:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:9712:x1874730541925248:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1787882604.338518:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882604.338555:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deeca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fcf expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.338603:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160100) 00010000:00010000:2.0:1787882604.338639:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787882604.338971:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deed1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.338988:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deed1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.339000:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deed1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787882604.339445:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d64c3a81 reply state 000000006f9dfc9b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deed1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882604.339456:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787882604.339473:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787882604.339590:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:9712:x1874730541925248:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 1147us (1327us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787882604.339600:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00010000:00010000:2.0:1787882604.346686:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deed1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.346716:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deed1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.346725:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deed1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.346732:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882604.346738:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deed1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.346759:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deed1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.346782:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:2.0:1787882604.346785:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787882604.346791:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deed1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.348379:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deed1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882604.383688:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882604.383801:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541925376 00000100:00100000:0.0:1787882604.383815:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541925376 00000100:00100000:0.0:1787882604.383946:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:0.0:1787882604.383959:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:9713:x1874730541925376:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:0.0:1787882604.383995:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882604.384037:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5deed8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842fd6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.384133:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deedf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.384151:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deedf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.384168:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deedf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882604.384288:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787882604.384294:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882604.384359:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deedf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.384397:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5deed8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fd6 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.384420:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deedf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fd6 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.384429:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160600) 00010000:00010000:0.0:1787882604.384433:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787882604.384438:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8200, rc 0) 00000100:00100000:0.0:1787882604.384543:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:9713:x1874730541925376:12345-192.168.206.21@tcp:101:chown.0 Request processed in 586us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882604.384562:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:3.0:1787882604.387327:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882604.387602:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541925504 00000100:00100000:2.0:1787882604.387613:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541925504 00000100:00100000:2.0:1787882604.387680:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:2.0:1787882604.387691:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:9713:x1874730541925504:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:2.0:1787882604.387709:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882604.387729:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842fdd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.387791:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5deeed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.387805:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5deeed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.387816:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5deeed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.387830:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5deef4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.387849:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5deef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.387856:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5deef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.387985:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5deefb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.387993:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5deefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.387999:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5deefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882604.388046:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787882604.388058:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882604.388081:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5deefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388093:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5deeed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388100:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5deeed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388106:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5deeed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388112:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882604.388115:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5deeed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388127:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5deeed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388148:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160600) 00010000:00010000:2.0:1787882604.388151:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882604.388155:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5deeed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388161:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5deeed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388174:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5deef4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388180:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5deef4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388185:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5deef4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388189:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882604.388192:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5deef4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388197:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5deef4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388203:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa285a00800) 00010000:00010000:2.0:1787882604.388205:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882604.388207:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5deef4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388221:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5deef4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388251:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5deee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fdd expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388263:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5deefb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fdd expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.388270:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882604.388272:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787882604.388274:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264a00, rc 0) 00000100:00100000:2.0:1787882604.388337:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:9713:x1874730541925504:12345-192.168.206.21@tcp:101:chown.0 Request processed in 648us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882604.388343:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:3.0:1787882604.396091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882604.396212:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541925760 00000100:00100000:0.0:1787882604.396227:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541925760 00000100:00100000:0.0:1787882604.396296:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:0.0:1787882604.396309:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:9713:x1874730541925760:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:0.0:1787882604.396389:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882604.396426:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5deefb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fdd expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.396451:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:0.0:1787882604.396466:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787882604.396499:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5def02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.396516:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5def02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.396529:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5def02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787882604.431960:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c0704a9 reply state 00000000f3dfd83a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5def02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882604.431993:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787882604.432205:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787882604.432366:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:9713:x1874730541925760:12345-192.168.206.21@tcp:36:chown.0 Request processed in 36052us (36398us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787882604.432377:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000001:00080000:3.0:1787882604.432949:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1787882604.433232:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5def02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.433246:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5def02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.433254:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5def02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.433262:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882604.433279:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5def02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.433288:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5def02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.433307:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa289160700) 00010000:00010000:0.0:1787882604.433311:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787882604.433317:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5def02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.433324:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9600/0xf4731e8a7c5def02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882604.463054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882604.463234:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541925888 00000100:00100000:2.0:1787882604.463247:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541925888 00000100:00100000:2.0:1787882604.463322:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:2.0:1787882604.463335:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:9714:x1874730541925888:12345-192.168.206.21@tcp:101:touch.500 00010000:00010000:2.0:1787882604.463368:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882604.463394:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5def09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842fe4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787882604.466772:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3308us 00010000:00010000:1.0:1787882604.489041:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489072:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489087:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489104:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489110:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489116:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489611:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffc00/0xf4731e8a7c5def1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489634:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffc00/0xf4731e8a7c5def1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489643:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffc00/0xf4731e8a7c5def1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882604.489728:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787882604.489733:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787882604.489932:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffc00/0xf4731e8a7c5def1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489949:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489956:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489963:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489970:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813ffa00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882604.489975:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489983:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.489998:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160600) 00010000:00010000:1.0:1787882604.490001:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882604.490007:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.490035:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.490050:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.490055:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.490061:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.490066:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813ff000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882604.490068:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.490075:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.490085:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa283291800) 00010000:00010000:1.0:1787882604.490087:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882604.490090:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.490095:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.490141:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5def09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fe4 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.490158:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffc00/0xf4731e8a7c5def1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fe4 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.490171:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa283291c00) 00010000:00010000:1.0:1787882604.490174:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787882604.490176:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813ffc00, rc 0) 00000100:00100000:1.0:1787882604.490276:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:9714:x1874730541925888:12345-192.168.206.21@tcp:101:touch.500 Request processed in 26941us (27234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882604.490287:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:0.0:1787882604.496165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882604.496632:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541926144 00000100:00100000:3.0:1787882604.496646:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541926144 00000100:00100000:3.0:1787882604.496721:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:3.0:1787882604.496733:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:9714:x1874730541926144:12345-192.168.206.21@tcp:101:touch.500 00010000:00010000:3.0:1787882604.496766:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882604.496796:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5def25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842feb expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.497277:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.497295:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.497309:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.497342:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.497350:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.497357:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787882604.498352:0:6733:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787882604.498723:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.498741:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.498752:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.498801:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.498810:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def2c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.498818:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.498824:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882604.498829:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.498849:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.498865:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa283291c00) 00010000:00010000:3.0:1787882604.498892:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882604.498898:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def2c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.498905:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787882604.498919:0:6733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003eb2b46b reply state 000000009e52da84 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882604.498929:0:6733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787882604.498974:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5def25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842feb expref: 10 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.498989:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842feb expref: 9 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.498997:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa2a0727d00) 00010000:00010000:3.0:1787882604.499000:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882604.499002:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67ce400, rc 0) 00000100:00100000:3.0:1787882604.499123:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:9714:x1874730541926144:12345-192.168.206.21@tcp:101:touch.500 Request processed in 2390us (2971us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787882604.499135:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:1.0:1787882604.509561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882604.509621:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541926400 00000100:00100000:2.0:1787882604.509636:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541926400 00000100:00100000:2.0:1787882604.509726:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:2.0:1787882604.509740:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:9714:x1874730541926400:12345-192.168.206.21@tcp:36:touch.500 00010000:00010000:2.0:1787882604.509820:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882604.509859:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842feb expref: 10 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.509921:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa2a0727d00) 00010000:00010000:2.0:1787882604.509935:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787882604.509995:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5def48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.510011:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5def48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.510036:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5def48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787882604.510225:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a76c5fe3 reply state 0000000088b2284e transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5def48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882604.510236:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787882604.510394:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:9714:x1874730541926400:12345-192.168.206.21@tcp:36:touch.500 Request processed in 656us (855us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787882604.510404:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00010000:00010000:3.0:1787882604.514484:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.514534:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882604.514678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:0.0:1787882604.514699:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5def48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.514711:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5def48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.514720:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5def48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.514728:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882604.514735:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5def48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.514744:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5def48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.514768:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:0.0:1787882604.514772:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882604.514787:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5def48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.514794:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5def48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882604.515043:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541926528 00000100:00100000:1.0:1787882604.515057:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541926528 00000100:00100000:1.0:1787882604.515127:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:1.0:1787882604.515141:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:9714:x1874730541926528:12345-192.168.206.21@tcp:101:touch.500 00010000:00010000:1.0:1787882604.515185:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882604.515214:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842ff2 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.515306:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ff2 expref: 11 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.515324:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ff2 expref: 11 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.515348:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa283291800) 00010000:00010000:1.0:1787882604.515352:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787882604.515355:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813ff000, rc 0) 00000100:00100000:1.0:1787882604.515439:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:9714:x1874730541926528:12345-192.168.206.21@tcp:101:touch.500 Request processed in 299us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882604.515461:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00010000:00010000:3.0:1787882604.518460:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.518470:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882604.518477:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.518490:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.518515:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc1d8c281 (ffff9fa2a0727a00) 00010000:00010000:3.0:1787882604.518520:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882604.518525:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.518533:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882604.520205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882604.520411:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541926656 00000100:00100000:3.0:1787882604.520424:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541926656 00000100:00100000:3.0:1787882604.520489:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:3.0:1787882604.520500:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874730541926656:12345-192.168.206.21@tcp:8:touch.500 00010000:00080000:3.0:1787882604.520557:0:6710:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:3.0:1787882604.520609:0:6710:0:(genops.c:1385:class_connect()) connect: client 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9, cookie 0xf4731e8a7c5def56 00002000:00100000:3.0:1787882604.520627:0:6710:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9/ffff9fa2a04db800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787882604.520697:0:6710:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787882604.521059:0:6710:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787882604.521100:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9fa2a04de000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787882604.521448:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2355:x1874730541926656:12345-192.168.206.21@tcp:8:touch.500 Request processed in 946us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882604.521458:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:0.0:1787882604.527626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882604.527787:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541926784 00000100:00100000:1.0:1787882604.527801:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541926784 00000100:00100000:1.0:1787882604.527927:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:1.0:1787882604.527941:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:0:x1874730541926784:12345-192.168.206.21@tcp:2:touch.500 00000100:00080000:0.0:1787882604.528468:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787882604.597493:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1787882604.597531:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000100:00100000:1.0:1787882604.597797:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:0:x1874730541926784:12345-192.168.206.21@tcp:2:touch.500 Request processed in 69843us (70173us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787882604.597813:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:2.0:1787882604.601118:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882604.601418:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541927040 00000100:00100000:1.0:1787882604.601431:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541927040 00000100:00100000:1.0:1787882604.601497:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:1.0:1787882604.601510:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:9714:x1874730541927040:12345-192.168.206.21@tcp:35:touch.500 00000100:00100000:1.0:1787882604.602356:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:9714:x1874730541927040:12345-192.168.206.21@tcp:35:touch.500 Request processed in 842us (1248us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787882604.602367:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:2.0:1787882604.629635:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882604.629978:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541927168 00000100:00100000:3.0:1787882604.629994:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541927168 00000100:00100000:3.0:1787882604.630115:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:3.0:1787882604.630131:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:9715:x1874730541927168:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1787882604.630163:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882604.630191:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a842ff9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.630296:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5def64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.630316:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5def64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.630330:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5def64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882604.630414:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787882604.630419:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882604.630474:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5def64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.630508:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ff9 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.630541:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5def64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ff9 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.630552:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa283291c00) 00010000:00010000:3.0:1787882604.630556:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787882604.630561:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cf000, rc 0) 00000100:00100000:3.0:1787882604.630647:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+12:9715:x1874730541927168:12345-192.168.206.21@tcp:101:rm.0 Request processed in 520us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882604.630655:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:2.0:1787882604.637258:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882604.637359:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541927424 00000100:00100000:0.0:1787882604.637373:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541927424 00000100:00100000:0.0:1787882604.637452:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:0.0:1787882604.637466:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+12:9715:x1874730541927424:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1787882604.637493:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882604.637518:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9e00/0xf4731e8a7c5def6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843000 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882604.637679:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787882604.637959:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9e00/0xf4731e8a7c5def6b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843000 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.637978:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160600) 00010000:00010000:0.0:1787882604.637980:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787882604.637986:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9e00/0xf4731e8a7c5def6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843000 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.638002:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9e00, rc 0) 00000100:00100000:0.0:1787882604.638079:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:9715:x1874730541927424:12345-192.168.206.21@tcp:101:rm.0 Request processed in 616us (835us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787882604.638097:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:2.0:1787882604.642759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882604.642913:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541927552 00000100:00100000:1.0:1787882604.642926:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541927552 00000100:00100000:1.0:1787882604.642998:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:1.0:1787882604.643012:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:9715:x1874730541927552:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:1.0:1787882604.651473:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:9715:x1874730541927552:12345-192.168.206.21@tcp:37:rm.0 Request processed in 8445us (8711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882604.651490:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00010000:00010000:1.0:1787882604.651575:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882604.666728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882604.666903:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541927808 00000100:00100000:0.0:1787882604.666918:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541927808 00000100:00100000:0.0:1787882604.666998:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:0.0:1787882604.667011:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa288322c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:9715:x1874730541927808:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:0.0:1787882604.670184:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa288322c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:9715:x1874730541927808:12345-192.168.206.21@tcp:35:rm.0 Request processed in 3157us (3452us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787882604.670205:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:2.0:1787882604.681303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882604.684250:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541928064 00000100:00100000:1.0:1787882604.684272:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541928064 00000100:00100000:1.0:1787882604.684384:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:1.0:1787882604.684398:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:9715:x1874730541928064:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1787882604.684429:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882604.684456:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843007 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.684622:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffe00/0xf4731e8a7c5def80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.684640:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffe00/0xf4731e8a7c5def80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.684654:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffe00/0xf4731e8a7c5def80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882604.684667:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787882604.685420:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5def79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843007 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.685446:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffe00/0xf4731e8a7c5def80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843007 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.685456:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa283291c00) 00010000:00010000:1.0:1787882604.685459:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787882604.685462:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2813ffe00, rc 0) 00000100:00100000:1.0:1787882604.685553:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:9715:x1874730541928064:12345-192.168.206.21@tcp:101:rm.0 Request processed in 1157us (4264us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787882604.685561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:2.0:1787882604.691763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882604.692328:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541928192 00000100:00100000:0.0:1787882604.692342:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541928192 00000100:00100000:0.0:1787882604.692415:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:0.0:1787882604.692428:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:9715:x1874730541928192:12345-192.168.206.21@tcp:41:rm.0 00000004:00000024:0.0:1787882604.692612:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787882604.692719:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:9715:x1874730541928192:12345-192.168.206.21@tcp:41:rm.0 Request processed in 293us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882604.692727:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:2.0:1787882604.696706:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882604.696933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541928320 00000100:00100000:3.0:1787882604.696946:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541928320 00000100:00100000:3.0:1787882604.697041:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:3.0:1787882604.697054:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:9715:x1874730541928320:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1787882604.697082:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882604.697108:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84300e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697192:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697209:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697223:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697242:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697270:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697278:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697465:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5defa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697475:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5defa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697482:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5defa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882604.697514:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787882604.697519:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882604.697540:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5defa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697554:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5defa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697563:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697570:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697576:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697593:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882604.697598:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697606:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697621:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa283291c00) 00010000:00010000:3.0:1787882604.697625:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882604.697631:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697638:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce600/0xf4731e8a7c5def95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697652:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697658:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697665:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697670:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882604.697672:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697679:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697699:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc1d8c281 (ffff9fa2a0727a00) 00010000:00010000:3.0:1787882604.697701:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882604.697704:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697710:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5def9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697756:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5def8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84300e expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697772:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5defa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84300e expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.697779:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa283291800) 00010000:00010000:3.0:1787882604.697782:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882604.697785:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cee00, rc 0) 00000100:00100000:3.0:1787882604.697921:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:9715:x1874730541928320:12345-192.168.206.21@tcp:101:rm.0 Request processed in 868us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882604.697929:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:2.0:1787882604.703397:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882604.703506:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541928576 00000100:00100000:1.0:1787882604.703536:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541928576 00000100:00100000:1.0:1787882604.703608:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:1.0:1787882604.703620:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:9715:x1874730541928576:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1787882604.703691:0:6733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787882604.703726:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5defa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84300e expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.703751:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ff000/0xf4731e8a7c5def4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ff2 expref: 16 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.703764:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa283291800) 00010000:00010000:1.0:1787882604.703782:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5def64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842ff9 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.703803:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa283291c00) 00010000:00010000:1.0:1787882604.703807:0:6733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787882604.703832:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5defaa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.703850:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5defaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.703860:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5defaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.703941:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5defb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.703951:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5defb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.703979:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5defb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.704184:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6800/0xf4731e8a7c5defb8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.704193:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6800/0xf4731e8a7c5defb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.704201:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6800/0xf4731e8a7c5defb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787882604.705122:0:6733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787882604.705138:0:6733:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320854267431ns, next at 321854264149ns, rc = 0 00010000:00010000:1.0:1787882604.705215:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5defbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705229:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5defbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705238:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5defbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705246:0:6733:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5defbf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705253:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5defbf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705258:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5defbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705292:0:6733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787882604.705319:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6800/0xf4731e8a7c5defb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705325:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6800/0xf4731e8a7c5defb8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705330:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6800/0xf4731e8a7c5defb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705336:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882604.705341:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6800/0xf4731e8a7c5defb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705348:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6800/0xf4731e8a7c5defb8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705362:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:1.0:1787882604.705366:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787882604.705370:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6800/0xf4731e8a7c5defb8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705376:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6800/0xf4731e8a7c5defb8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705394:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5defaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705400:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5defaa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705406:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5defaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705418:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813ffa00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882604.705421:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5defaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705427:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5defaa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705436:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa283291c00) 00010000:00010000:1.0:1787882604.705439:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882604.705442:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5defaa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882604.705448:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffa00/0xf4731e8a7c5defaa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787882604.705459:0:6733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000053d27bd1 reply state 00000000097119d1 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5defb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882604.705468:0:6733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787882604.705583:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:9715:x1874730541928576:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1961us (2196us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787882604.705594:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00010000:00010000:3.0:1787882604.706409:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882604.706420:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5defbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.706430:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882604.706435:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5defbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.706459:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5defbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.706474:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:3.0:1787882604.706477:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787882604.706480:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5defbf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.706486:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5defbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.706504:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882604.706506:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882604.706508:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882604.708653:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5defb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.708675:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5defb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.708683:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5defb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.708689:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882604.708695:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5defb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.708702:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5defb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.708722:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc1d8c281 (ffff9fa283291100) 00010000:00010000:3.0:1787882604.708741:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882604.708746:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5defb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.708754:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5defb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc1d8c281 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882604.714201:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882604.714289:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541928832 00000100:00100000:0.0:1787882604.714302:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541928832 00000100:00100000:0.0:1787882604.714373:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:0.0:1787882604.714386:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:9715:x1874730541928832:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:0.0:1787882604.714724:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:9715:x1874730541928832:12345-192.168.206.21@tcp:35:rm.0 Request processed in 340us (537us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787882604.714733:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:2.0:1787882604.721216:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882604.721346:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541929088 00000100:00100000:3.0:1787882604.721360:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541929088 00000100:00100000:3.0:1787882604.721436:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:3.0:1787882604.721449:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:9715:x1874730541929088:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1787882604.721523:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787882604.721558:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffe00/0xf4731e8a7c5def80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843007 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.721587:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2813ffc00/0xf4731e8a7c5def1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fe4 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.721600:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa283291c00) 00010000:00010000:3.0:1787882604.721620:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5deedf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fd6 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.721629:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160600) 00010000:00010000:3.0:1787882604.721654:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787882604.721689:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5defc6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.721706:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5defc6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.721744:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5defc6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.721763:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5defcd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.721771:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5defcd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882604.721777:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5defcd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723158:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5defd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723176:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5defd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723187:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5defd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882604.723806:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787882604.723829:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5defd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723838:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5defd4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723846:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5defd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723852:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882604.723857:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5defd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723903:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5defd4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723918:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fa285a00600) 00010000:00010000:2.0:1787882604.723921:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787882604.723925:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5defd4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723932:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5defd4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723956:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5defc6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723963:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5defc6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723969:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5defc6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723974:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882604.723977:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5defc6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723982:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5defc6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.723989:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727a00) 00010000:00010000:2.0:1787882604.723991:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882604.723993:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5defc6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882604.724007:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5defc6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787882604.724038:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee529f60 reply state 00000000205cd656 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5defcd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882604.724048:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787882604.724154:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:9715:x1874730541929088:12345-192.168.206.21@tcp:36:rm.0 Request processed in 2703us (2951us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787882604.724164:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00010000:00010000:0.0:1787882604.726371:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5defcd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.726412:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5defcd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.726420:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5defcd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.726426:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882604.726431:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5defcd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.726440:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5defcd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.726460:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fa2a0727500) 00010000:00010000:0.0:1787882604.726463:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882604.726467:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5defcd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882604.726473:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5defcd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882604.842254:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563979904:0@lo:400:kworker.0 00000100:00100000:1.0:1787882604.842278:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563980032:0@lo:400:kworker.0 00000100:00100000:3.0:1787882604.842370:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563980288:0@lo:400:kworker.0 00000100:00100000:2.0:1787882604.842377:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882604.842419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882604.842482:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563980288 00000100:00100000:3.0:1787882604.842491:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563980288 00000100:00100000:3.0:1787882604.842579:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787882604.842592:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563980288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882604.842615:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563980416:0@lo:400:kworker.0 00000100:00080000:0.0:1787882604.842628:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882604.842653:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563979904 00000100:00100000:2.0:1787882604.842656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882604.842658:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563979904 00000100:00100000:3.0:1787882604.842689:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563980288:12345-0@lo:400:kworker.0 Request processed in 90us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882604.842691:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787882604.842702:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563979904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882604.842704:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787882604.842713:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2bf48e300 x1874730563980288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882604.842729:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563980288:0@lo:400:kworker.0 00000100:00100000:0.0:1787882604.842751:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563979904:12345-0@lo:400:kworker.0 Request processed in 50us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882604.842758:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787882604.842773:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563979904:0@lo:400:kworker.0 00000100:00100000:3.0:1787882604.842820:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563980416 00000100:00100000:3.0:1787882604.842824:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563980416 00000100:00100000:0.0:1787882604.842834:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563980160:0@lo:400:kworker.0 00000100:00100000:3.0:1787882604.842892:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787882604.842901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882604.842904:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563980416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882604.842928:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563980672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882604.842959:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563980416:12345-0@lo:400:kworker.0 Request processed in 59us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882604.842974:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787882604.842985:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882604.842987:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563980160 00000100:00100000:3.0:1787882604.842990:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563980160 00000100:00100000:3.0:1787882604.843005:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563980032 00000100:00100000:3.0:1787882604.843008:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563980032 00000100:00100000:1.0:1787882604.843008:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563980544:0@lo:400:kworker.0 00000100:00100000:1.0:1787882604.843044:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882604.843049:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787882604.843055:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563980160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882604.843651:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787882604.843665:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563980032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882604.843768:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882604.844640:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563980160:12345-0@lo:400:kworker.0 Request processed in 1580us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882604.844653:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787882604.844739:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563980416:0@lo:400:kworker.0 00000100:00080000:3.0:1787882604.845619:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882604.845660:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563980544 00000100:00100000:3.0:1787882604.845671:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563980544 00000100:00100000:1.0:1787882604.845769:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563980672 00000100:00100000:1.0:1787882604.845775:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563980672 00000100:00100000:3.0:1787882604.846321:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787882604.846334:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563980544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882604.846633:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563980160:0@lo:400:kworker.0 00000100:00100000:1.0:1787882604.847752:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787882604.847763:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563980672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882604.847818:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882604.847927:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1155880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563980672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (4946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882604.847935:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787882604.847990:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa29d8a1c00 x1874730563980672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882604.848026:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563980672:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787882604.848093:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882604.848899:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563980544:12345-0@lo:400:kworker.0 Request processed in 2535us (5820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882604.848919:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787882604.851646:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563980032:12345-0@lo:400:kworker.0 Request processed in 7970us (8645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882604.851664:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787882604.851852:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563980032:0@lo:400:kworker.0 00010000:00080000:1.0:1787882604.852093:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2bf48ca80 x1874730563980544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882604.852107:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563980544:0@lo:400:kworker.0 00000100:00100000:3.0:1787882605.357361:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563980800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882605.357464:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882605.357621:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563980800 00000100:00100000:1.0:1787882605.357633:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563980800 00000100:00100000:1.0:1787882605.357699:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787882605.357710:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563980800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882605.357741:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882605.357802:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563980800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882605.357810:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787882605.358235:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2bf48ca80 x1874730563980800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882605.358261:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563980800:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787882605.674361:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882606.249030:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882606.249075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882606.249117:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882606.249178:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882606.249226:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541929344 00000100:00100000:2.0:1787882606.249239:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541929344 00000100:00100000:2.0:1787882606.249308:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541929600 00000100:00100000:2.0:1787882606.249312:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541929600 00000100:00100000:2.0:1787882606.249338:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 100 00000100:00100000:2.0:1787882606.249350:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:2357:x1874730541929344:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882606.249678:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:2357:x1874730541929344:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 329us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882606.249688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 100 00000100:00100000:2.0:1787882606.249720:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 101 00000100:00100000:2.0:1787882606.249727:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541929600:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882606.249758:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541929600:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882606.249764:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 101 00000100:00100000:2.0:1787882606.249790:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541929216 00000100:00100000:2.0:1787882606.249795:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541929216 00000100:00100000:2.0:1787882606.249823:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 249 00000100:00100000:2.0:1787882606.249830:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541929216:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882606.249856:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541929216:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882606.249862:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 249 00000100:00100000:2.0:1787882606.249920:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541929472 00000100:00100000:2.0:1787882606.249924:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541929472 00000100:00100000:2.0:1787882606.249957:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:2.0:1787882606.249964:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541929472:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882606.250016:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541929472:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 42us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882606.250024:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00080000:1.0:1787882606.250531:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882606.250537:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787882606.698348:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882607.723074:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787882608.715823:0:11625:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787882608.747095:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787882609.534387:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:1.0:1787882609.534405:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787882609.534567:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563980928:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787882609.534635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882609.534688:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563980928 00000100:00100000:0.0:1787882609.534696:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563980928 00000001:00080000:1.0:1787882609.534738:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1787882609.534748:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787882609.534758:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563980928:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1787882609.534789:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1787882609.534827:0:6711:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787882609.534861:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a90ec6c, atime: 0x6a90ec6c, ctime: 0x6a90ec6c, blocks: 0x1 00010000:00010000:0.0:1787882609.534904:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068260057/0xf4731e8a7c5defdb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882609.534921:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:0.0:1787882609.534925:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882609.534932:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068260057/0xf4731e8a7c5defdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882609.534950:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068260057/0xf4731e8a7c5defdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882609.534972:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068260057/0xf4731e8a7c5defdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882609.534979:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068260057/0xf4731e8a7c5defdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882609.535013:0:6711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787882609.535651:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882609.535658:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068260057/0xf4731e8a7c5defdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.535669:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882609.535674:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068260057/0xf4731e8a7c5defdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.535683:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068260057/0xf4731e8a7c5defdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.535702:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068260057/0xf4731e8a7c5defdb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.535708:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068260057/0xf4731e8a7c5defdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.535725:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882609.535727:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882609.535729:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882609.536240:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1874730563980928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1478us (1600us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787882609.536250:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1787882609.536463:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2a998e300/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787882609.536479:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563980928:0@lo:6:osp-syn-1-0.0 00000020:00000080:3.0:1787882609.761555:0:11675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7d3894f0 20000000:00000080:3.0:1787882609.761574:0:11675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa2b9ad3000 uarg=0000000000000000 20000000:01000000:3.0:1787882609.761622:0:11675:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787882609.761629:0:11675:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787882609.761633:0:11675:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787882609.762558:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787882609.762720:0:11675:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787882609.769591:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787882609.769642:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787882609.769694:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787882609.769721:0:11675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787882609.769741:0:11675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.769759:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5dee84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee7d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.769767:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee8b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.769773:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5deea0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dee99 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.769783:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5deea7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc1 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.769790:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5deeae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc8 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.769798:0:11675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.769836:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5deeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc8 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.769853:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5deeae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc8 expref: 12 pid: 5838 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882609.770197:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874730563981056:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882609.770361:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5deea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc1 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.770383:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5deea7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc1 expref: 12 pid: 5838 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882609.770393:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874730563981184:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882609.770430:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5deea0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dee99 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.770438:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5deea0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee99 expref: 18 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882609.770447:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874730563981312:0@lo:104: 00000100:00100000:1.0:1787882609.770484:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882609.770517:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563981312 00000100:00100000:1.0:1787882609.770524:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563981312 00000100:00100000:1.0:1787882609.770563:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787882609.770571:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:11675:x1874730563981312:12345-0@lo:104: 00010000:00010000:1.0:1787882609.770583:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.770623:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787882609.770629:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:11675:x1874730563981312:12345-0@lo:104: Request processed in 59us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882609.770636:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1787882609.770657:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882609.770662:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.770680:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2813fe800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882609.770684:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.770692:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882609.770700:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882609.770705:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787882609.770732:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.770738:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882609.770754:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882609.770842:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882609.770913:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787882609.770926:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563981440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882609.770958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882609.771011:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563981440 00000100:00100000:3.0:1787882609.771015:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563981440 00010000:00010000:3.0:1787882609.771034:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5deea0 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee99 expref: 19 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882609.771056:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787882609.771062:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563981440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882609.771072:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882609.771077:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5deea0 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee99 expref: 19 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882609.771086:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5deea0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee99 expref: 19 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882609.771099:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882609.771127:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563981440:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882609.771134:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787882609.771179:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563981440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787882609.771497:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dee8b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.771507:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee8b expref: 18 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882609.771516:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1401500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874730563981568:0@lo:104: 00000100:00100000:2.0:1787882609.771542:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787882609.771564:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5dee84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dee7d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.771572:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5dee84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee7d expref: 18 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882609.771580:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874730563981696:0@lo:104: 00000100:00100000:2.0:1787882609.771604:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882609.771617:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a0440f00 going to sleep for 11 seconds 00010000:00010000:2.0:1787882609.771633:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813ff800/0xf4731e8a7c5deea0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dee99 expref: 18 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882609.771646:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874730563981312:0@lo:104: 00000100:00100000:2.0:1787882609.771679:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787882609.771689:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563981568 00000100:00100000:2.0:1787882609.771693:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563981568 00000100:00100000:2.0:1787882609.771711:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563981696 00000100:00100000:2.0:1787882609.771720:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563981696 00000100:00100000:2.0:1787882609.771742:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787882609.771748:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:11675:x1874730563981568:12345-0@lo:104: 00010000:00010000:2.0:1787882609.771757:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.771803:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787882609.771808:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+4:11675:x1874730563981568:12345-0@lo:104: Request processed in 61us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882609.771814:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787882609.771831:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787882609.771837:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1618450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:11675:x1874730563981696:12345-0@lo:104: 00010000:00010000:2.0:1787882609.771844:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.771886:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787882609.771892:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1618450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+3:11675:x1874730563981696:12345-0@lo:104: Request processed in 56us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882609.771898:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787882609.771943:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1401500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874730563981568:0@lo:104: 00000100:00100000:2.0:1787882609.771949:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874730563981696:0@lo:104: 00010000:00010000:2.0:1787882609.771967:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787882609.772102:0:11677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882609.772109:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772117:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265600 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1787882609.772120:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772134:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882609.772141:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882609.772147:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787882609.772170:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772177:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787882609.772191:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772197:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265600/0xf4731e8a7c5dee8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee92 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772207:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882609.772208:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882609.772210:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882609.772272:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563981824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787882609.772301:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787882609.772366:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882609.772371:0:11677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772378:0:11677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1787882609.772380:0:11677:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772397:0:11677:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882609.772404:0:11677:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882609.772409:0:11677:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787882609.772435:0:11677:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772441:0:11677:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787882609.772454:0:11677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772460:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265000/0xf4731e8a7c5dee7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dee84 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772469:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882609.772470:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882609.772472:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882609.772476:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882609.772477:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882609.772490:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563981952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787882609.772517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882609.772554:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563981824 00000100:00100000:2.0:1787882609.772559:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563981824 00010000:00010000:2.0:1787882609.772575:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee8b expref: 18 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882609.772594:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563981952 00000100:00100000:2.0:1787882609.772603:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563981952 00010000:00010000:2.0:1787882609.772616:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5dee84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee7d expref: 19 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882609.772634:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787882609.772641:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563981824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787882609.772651:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882609.772656:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee8b expref: 19 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772665:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee8b expref: 19 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772677:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fe200/0xf4731e8a7c5dee92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dee8b expref: 19 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772690:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882609.772718:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:3308:x1874730563981824:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882609.772724:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787882609.772739:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787882609.772745:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286600850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:3305:x1874730563981952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787882609.772752:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882609.772755:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5dee84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee7d expref: 17 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772763:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5dee84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dee7d expref: 17 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772772:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fee00/0xf4731e8a7c5dee84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dee7d expref: 17 pid: 5835 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.772787:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882609.772815:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286600850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3305:x1874730563981952:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882609.772821:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787882609.772898:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563981824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787882609.772921:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563981952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787882609.773017:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2813fe800/0xf4731e8a7c5dee99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5deea0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882609.773034:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882609.773035:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882609.773037:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882609.781340:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874730563981056:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882609.781358:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874730563981184:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882609.781397:0:11675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882609.781932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882609.782013:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882609.782244:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541929856 00000100:00100000:2.0:1787882609.782252:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541929856 00010000:00010000:2.0:1787882609.782290:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5deea7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc1 expref: 13 pid: 5838 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882609.782315:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541929728 00000100:00100000:2.0:1787882609.782319:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541929728 00010000:00010000:2.0:1787882609.782330:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5deeae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc8 expref: 14 pid: 5838 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882609.782358:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:2.0:1787882609.782368:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+14:2357:x1874730541929856:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882609.782382:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882609.782387:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5deea7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc1 expref: 14 pid: 5838 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782398:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5deea7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc1 expref: 14 pid: 5838 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782414:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fe000/0xf4731e8a7c5deea7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc1 expref: 14 pid: 5838 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782443:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882609.782494:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1154380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541929856:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 128us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882609.782501:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:2.0:1787882609.782522:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:2.0:1787882609.782528:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:2357:x1874730541929728:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882609.782536:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882609.782540:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5deeae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc8 expref: 12 pid: 5838 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782550:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5deeae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc8 expref: 12 pid: 5838 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782560:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5deeae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842fc8 expref: 12 pid: 5838 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782570:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782578:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782592:0:8466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782599:0:8466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782615:0:8466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782622:0:8466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782629:0:8466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882609.782633:0:8466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782640:0:8466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782651:0:8466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882609.782659:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882609.782680:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1156300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:2357:x1874730541929728:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 151us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882609.782686:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 34 00010000:00010000:0.0:1787882609.783196:0:11675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882609.783205:0:11675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882609.783211:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa289fa7800/0xf4731e8a7c5defe2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882609.964560:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563982080:0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.964632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882609.964678:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563982592:0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.964705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882609.964932:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787882609.964939:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563982464:0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.964968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882609.965016:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563982208:0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.965041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882609.965060:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563982720:0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.965080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882609.965097:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787882609.965102:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563982336:0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.965122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882609.965139:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563982848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787882609.965161:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882609.965193:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563982592 00000100:00100000:1.0:1787882609.965199:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563982592 00000100:00100000:1.0:1787882609.965245:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563982208 00000100:00100000:1.0:1787882609.965248:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563982208 00000100:00100000:1.0:1787882609.965259:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563982336 00000100:00100000:1.0:1787882609.965262:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563982336 00000100:00100000:1.0:1787882609.965277:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787882609.965285:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563982592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.965334:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563982592:12345-0@lo:400:kworker.0 Request processed in 49us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882609.965340:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787882609.965355:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787882609.965361:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563982208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.965391:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563982208:12345-0@lo:400:kworker.0 Request processed in 30us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882609.965406:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787882609.965419:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787882609.965425:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563982336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.965453:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563982336:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882609.965458:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787882609.965622:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563982464 00000100:00100000:0.0:1787882609.965628:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563982464 00000100:00100000:0.0:1787882609.965662:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563982720 00000100:00100000:0.0:1787882609.965666:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563982720 00000100:00100000:0.0:1787882609.965687:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787882609.965695:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563982464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882609.965732:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563982464:12345-0@lo:400:kworker.0 Request processed in 39us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882609.965747:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787882609.965774:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787882609.965781:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730563982720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882609.965808:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730563982720:12345-0@lo:400:kworker.0 Request processed in 29us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882609.965814:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787882609.967789:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563982080 00000100:00100000:3.0:1787882609.967800:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563982080 00000100:00100000:3.0:1787882609.967845:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787882609.967854:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3306:x1874730563982080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882609.967952:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3306:x1874730563982080:12345-0@lo:400:kworker.0 Request processed in 99us (3320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882609.967960:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1787882609.970204:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563982848 00000100:00100000:0.0:1787882609.970218:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563982848 00000100:00100000:0.0:1787882609.970278:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787882609.970288:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563982848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882609.970324:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882609.970400:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563982848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (5237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882609.970407:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1787882609.976169:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787882609.976178:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882609.976235:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563982336:0@lo:400:kworker.0 00010000:00080000:1.0:1787882609.976255:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1155f80 x1874730563982848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882609.976277:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563982848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787882609.976290:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563982208:0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.976303:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563982720:0@lo:400:kworker.0 00010000:00080000:1.0:1787882609.976351:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2bf48ed80 x1874730563982464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882609.976361:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563982464:0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.976372:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563982080:0@lo:400:kworker.0 00000100:00100000:1.0:1787882609.976385:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563982592:0@lo:400:kworker.0 00000001:00080000:0.0:1787882610.034564:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:0.0:1787882610.474506:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787882610.474539:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563982976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787882610.474605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882610.474729:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563982976 00000100:00100000:1.0:1787882610.474737:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563982976 00000100:00100000:1.0:1787882610.474787:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787882610.474804:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563982976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882610.474837:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882610.474908:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1154a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563982976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882610.474916:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787882610.475182:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787882610.475187:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2a998e300, transno 4294967300 00000100:00100000:0.0:1787882610.475211:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563982976:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787882610.794335:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882610.914440:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882610.914541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541929984 00000100:00100000:0.0:1787882610.914551:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541929984 00000100:00100000:0.0:1787882610.914604:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 251 00000100:00100000:0.0:1787882610.914615:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:5611:x1874730541929984:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882610.914633:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882610.914661:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b67d9e00/0xf4731e8a7c5defe9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843015 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882610.914689:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67d9e00/0xf4731e8a7c5defe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843015 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882610.914700:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b67d9e00/0xf4731e8a7c5defe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843015 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882610.914710:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9e00, rc 0) 00000100:00100000:0.0:1787882610.914772:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541929984:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 159us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882610.914779:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 251 00000100:00100000:0.0:1787882610.917799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882610.922254:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541930112 00000100:00100000:3.0:1787882610.922271:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541930112 00000100:00100000:3.0:1787882610.922333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 252 00000100:00100000:3.0:1787882610.922344:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541930112:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882610.922655:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541930112:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 311us (4863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882610.922663:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 252 00000100:00100000:2.0:1787882610.931195:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882610.931299:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541930240 00000100:00100000:3.0:1787882610.931310:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541930240 00000100:00100000:3.0:1787882610.931374:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 253 00000100:00100000:3.0:1787882610.931384:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541930240:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787882610.931819:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541930240:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 435us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882610.931827:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 253 00000100:00100000:2.0:1787882610.936923:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882610.938043:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541930368 00000100:00100000:3.0:1787882610.938055:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541930368 00000100:00100000:3.0:1787882610.938164:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 254 00000100:00100000:3.0:1787882610.938176:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:9985:x1874730541930368:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787882610.938440:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:9985:x1874730541930368:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 266us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882610.938449:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 254 00000100:00100000:0.0:1787882610.948240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882610.949199:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541930496 00000100:00100000:3.0:1787882610.949212:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541930496 00000100:00100000:3.0:1787882610.949293:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 255 00000100:00100000:3.0:1787882610.949304:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa285bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:9985:x1874730541930496:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787882610.949560:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa285bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:9985:x1874730541930496:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 257us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882610.949569:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 255 00000100:00100000:2.0:1787882610.955055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882610.955296:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541930624 00000100:00100000:3.0:1787882610.955308:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541930624 00000100:00100000:3.0:1787882610.955369:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 256 00000100:00100000:3.0:1787882610.955380:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa28660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:5611:x1874730541930624:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882610.955395:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882610.955412:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b67ce800/0xf4731e8a7c5deff0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84301c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882610.955440:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67ce800/0xf4731e8a7c5deff0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84301c expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882610.955451:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b67ce800/0xf4731e8a7c5deff0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84301c expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882610.955459:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67ce800, rc 0) 00000100:00100000:3.0:1787882610.955517:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa28660a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:5611:x1874730541930624:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 139us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882610.955537:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 256 00000100:00100000:2.0:1787882610.962078:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882610.962170:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541930752 00000100:00100000:0.0:1787882610.962180:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541930752 00000100:00100000:0.0:1787882610.962234:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 257 00000100:00100000:0.0:1787882610.962245:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:5611:x1874730541930752:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882610.962554:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:5611:x1874730541930752:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 310us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882610.962563:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 257 00000100:00100000:1.0:1787882610.971300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882610.971464:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541930880 00000100:00100000:3.0:1787882610.971473:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541930880 00000100:00100000:3.0:1787882610.971539:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 258 00000100:00100000:3.0:1787882610.971551:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:5611:x1874730541930880:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787882610.971806:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:5611:x1874730541930880:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 256us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882610.971813:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 258 00000100:00100000:2.0:1787882610.984698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882610.984798:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541931008 00000100:00100000:3.0:1787882610.984809:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541931008 00000100:00100000:3.0:1787882610.984911:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 259 00000100:00100000:3.0:1787882610.984922:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa28660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:9988:x1874730541931008:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787882610.985168:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa28660b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:9988:x1874730541931008:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 247us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882610.985177:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 259 00000100:00100000:1.0:1787882610.995398:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882610.995549:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541931136 00000100:00100000:2.0:1787882610.995558:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541931136 00000100:00100000:2.0:1787882610.995619:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 260 00000100:00100000:2.0:1787882610.995628:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:9988:x1874730541931136:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787882610.996472:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:9988:x1874730541931136:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 839us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882610.996482:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 260 00000100:00100000:1.0:1787882611.362442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882611.363623:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541931264 00000100:00100000:2.0:1787882611.363636:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541931264 00000100:00100000:2.0:1787882611.363715:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 105 00000100:00080000:1.0:1787882611.363716:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882611.363731:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2356:x1874730541931264:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882611.363810:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2356:x1874730541931264:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882611.363818:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 105 00000100:00100000:0.0:1787882611.370135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882611.370179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882611.370511:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541931520 00000100:00100000:1.0:1787882611.370521:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541931520 00000100:00100000:1.0:1787882611.370597:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 106 00000100:00100000:1.0:1787882611.370607:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541931520:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882611.370677:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541931520:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 71us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882611.370685:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 106 00000100:00080000:3.0:1787882611.370897:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882611.370911:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541931392 00000100:00100000:2.0:1787882611.370916:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541931392 00000100:00100000:2.0:1787882611.370966:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:2.0:1787882611.370974:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541931392:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882611.371033:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541931392:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 60us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882611.371040:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00080000:3.0:1787882611.371177:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:2.0:1787882611.627319:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787882611.627328:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2c174b000 from 7 10000000:01000000:2.0:1787882611.627332:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787882611.627381:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.627393:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.627423:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882611.627448:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563983104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.627514:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882611.627585:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa286075b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882611.627670:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563983104 00000100:00100000:0.0:1787882611.627677:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563983104 00000100:00100000:0.0:1787882611.627729:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787882611.627738:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:5841:x1874730563983104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882611.627762:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882611.627776:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b67d9600/0xf4731e8a7c5deffe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5deff7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882611.627799:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67d9600/0xf4731e8a7c5deffe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5deff7 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882611.627810:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b67d9600/0xf4731e8a7c5deffe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5deff7 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882611.627820:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9600, rc 0) 00000100:00100000:0.0:1787882611.627864:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563983104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882611.627911:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787882611.628111:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563983104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787882611.628125:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.628134:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882611.628187:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563983232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.628216:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882611.628249:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa286075b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787882611.628312:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563983232 00000100:00100000:3.0:1787882611.628317:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563983232 00000100:00100000:3.0:1787882611.628355:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787882611.628363:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563983232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882611.628615:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563983232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882611.628622:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787882611.628695:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563983232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.628724:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563983360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.628776:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882611.628797:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa286075b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787882611.629009:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563983360 00000100:00100000:1.0:1787882611.629014:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563983360 00000100:00100000:1.0:1787882611.629035:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787882611.629041:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563983360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882611.629190:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563983360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882611.629196:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787882611.629271:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563983360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.629637:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11692:1874730563983488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882611.629672:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882611.629701:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa286075b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787882611.629751:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563983488 00000100:00100000:1.0:1787882611.629755:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563983488 00000100:00100000:1.0:1787882611.629788:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787882611.629794:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:11692:x1874730563983488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882611.629965:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:11692:x1874730563983488:12345-0@lo:502:llog_process_th.0 Request processed in 171us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882611.629973:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787882611.630185:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11692:1874730563983488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787882611.630211:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787882611.630221:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882611.630224:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787882611.630231:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa2c174b000 00000020:00000080:2.0:1787882611.630233:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787882611.630312:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11692:1874730563983616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882611.630351:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882611.630371:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7155f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787882611.630432:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563983616 00000100:00100000:3.0:1787882611.630442:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563983616 00000100:00100000:3.0:1787882611.630465:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787882611.630471:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:11692:x1874730563983616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787882611.630611:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:11692:x1874730563983616:12345-0@lo:502:llog_process_th.0 Request processed in 139us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882611.630619:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787882611.630699:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11692:1874730563983616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787882611.630718:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787882611.630722:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882611.630724:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787882611.630727:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787882611.630989:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787882611.631004:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787882611.631012:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882611.631022:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882611.631030:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787882611.631033:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa29d82f000 from 7 10000000:01000000:3.0:1787882611.631035:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787882611.631055:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882611.631062:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882611.631070:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882611.631082:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563983744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787882611.631108:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882611.631130:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6261000 going to sleep for 11 seconds 00000100:00100000:2.0:1787882611.631199:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563983744 00000100:00100000:2.0:1787882611.631203:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563983744 00000100:00100000:2.0:1787882611.631221:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787882611.631226:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:5841:x1874730563983744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787882611.631233:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882611.631243:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b7264200/0xf4731e8a7c5df00c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5df005 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.631260:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b7264200/0xf4731e8a7c5df00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5df005 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.631269:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b7264200/0xf4731e8a7c5df00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5df005 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.631277:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264200, rc 0) 00000100:00100000:2.0:1787882611.631309:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563983744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882611.631315:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787882611.631387:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563983744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882611.631403:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882611.631411:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882611.631451:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563983872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882611.631473:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882611.631493:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6261000 going to sleep for 11 seconds 00000100:00100000:0.0:1787882611.631556:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563983872 00000100:00100000:0.0:1787882611.631560:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563983872 00000100:00100000:0.0:1787882611.631581:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787882611.631587:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563983872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882611.631833:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563983872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882611.631840:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787882611.632083:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563983872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882611.632108:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563984000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787882611.632143:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882611.632172:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6261000 going to sleep for 11 seconds 00000100:00100000:2.0:1787882611.632230:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563984000 00000100:00100000:2.0:1787882611.632235:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563984000 00000100:00100000:2.0:1787882611.632253:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787882611.632258:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563984000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.632388:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563984000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882611.632395:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787882611.632470:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563984000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787882611.634946:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11693:1874730563984128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787882611.635038:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882611.635075:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6261540 going to sleep for 11 seconds 00000100:00100000:2.0:1787882611.635188:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563984128 00000100:00100000:2.0:1787882611.635195:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563984128 00000100:00100000:2.0:1787882611.635236:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787882611.635243:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:11693:x1874730563984128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882611.635445:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:11693:x1874730563984128:12345-0@lo:502:llog_process_th.0 Request processed in 201us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882611.635452:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1787882611.635546:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11693:1874730563984128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787882611.635574:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787882611.635583:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882611.635585:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787882611.635591:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa29d82f000 00000020:00000080:0.0:1787882611.635593:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787882611.635671:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1155500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11693:1874730563984256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787882611.635706:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882611.635737:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a9891540 going to sleep for 11 seconds 00000100:00100000:2.0:1787882611.636854:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563984256 00000100:00100000:2.0:1787882611.636862:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563984256 00000100:00100000:2.0:1787882611.636927:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787882611.636936:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:11693:x1874730563984256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882611.637144:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:11693:x1874730563984256:12345-0@lo:502:llog_process_th.0 Request processed in 208us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882611.637151:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787882611.637220:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1155500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11693:1874730563984256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787882611.637247:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787882611.637258:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882611.637260:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787882611.637264:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787882611.637317:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787882611.637333:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787882611.637341:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.637350:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882611.637360:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787882611.637362:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa285a97800 from 7 10000000:01000000:2.0:1787882611.637365:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787882611.637389:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.637395:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.637403:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882611.637419:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563984384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.637450:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882611.637475:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29832bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787882611.637485:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563984384 00000100:00100000:2.0:1787882611.637489:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563984384 00000100:00100000:2.0:1787882611.637506:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787882611.637510:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:5841:x1874730563984384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787882611.637517:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882611.637533:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b7265a00/0xf4731e8a7c5df01a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5df013 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.637551:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b7265a00/0xf4731e8a7c5df01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5df013 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.637559:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b7265a00/0xf4731e8a7c5df01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5df013 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.637567:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265a00, rc 0) 00000100:00100000:2.0:1787882611.637591:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563984384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882611.637596:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787882611.637624:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563984384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787882611.637636:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.637644:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882611.637684:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563984512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.637708:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882611.637720:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a99e3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787882611.637730:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563984512 00000100:00100000:2.0:1787882611.637733:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563984512 00000100:00100000:2.0:1787882611.637748:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787882611.637771:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563984512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.637989:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563984512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882611.638002:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787882611.638032:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563984512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.638055:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563984640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.638083:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882611.638100:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a99e3900 going to sleep for 11 seconds 00000100:00100000:2.0:1787882611.638109:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563984640 00000100:00100000:2.0:1787882611.638112:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563984640 00000100:00100000:2.0:1787882611.638125:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787882611.638129:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563984640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.638225:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:5841:x1874730563984640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882611.638231:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787882611.638261:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8fe006bc-8a96-494d-a4af-8dd699ee0b84:5841:1874730563984640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882611.638439:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11695:1874730563984768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882611.638467:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882611.638482:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563984768 00000100:00100000:2.0:1787882611.638485:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563984768 00000100:00100000:2.0:1787882611.638500:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787882611.638504:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:11695:x1874730563984768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882611.638600:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:11695:x1874730563984768:12345-0@lo:502:llog_process_th.0 Request processed in 94us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882611.638605:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787882611.638633:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a99e3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787882611.638644:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11695:1874730563984768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787882611.638669:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787882611.638676:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882611.638678:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787882611.638685:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa285a97800 00000020:00000080:2.0:1787882611.638687:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787882611.638740:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11695:1874730563984896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882611.638767:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882611.638782:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563984896 00000100:00100000:2.0:1787882611.638785:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563984896 00000100:00100000:2.0:1787882611.638801:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787882611.638805:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:11695:x1874730563984896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882611.638925:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:11695:x1874730563984896:12345-0@lo:502:llog_process_th.0 Request processed in 118us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882611.638931:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787882611.638966:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a99e3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787882611.638991:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8fe006bc-8a96-494d-a4af-8dd699ee0b84:11695:1874730563984896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787882611.639008:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787882611.639011:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882611.639013:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787882611.639016:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787882611.639052:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787882611.639061:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787882611.639069:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882611.639077:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787882611.654344:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787882611.818112:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787882612.715720:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787882612.842315:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882613.866041:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882614.890227:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882615.082200:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563985152:0@lo:400:kworker.0 00000100:00100000:1.0:1787882615.082311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882615.082369:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563985664:0@lo:400:kworker.0 00000100:00100000:1.0:1787882615.082392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882615.082418:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787882615.082424:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563985280:0@lo:400:kworker.0 00000100:00100000:1.0:1787882615.082442:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882615.082642:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563985408:0@lo:400:kworker.0 00000100:00100000:3.0:1787882615.082671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882615.082707:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787882615.082712:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563985024:0@lo:400:kworker.0 00000100:00100000:3.0:1787882615.082757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882615.082779:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563985536:0@lo:400:kworker.0 00000100:00100000:3.0:1787882615.082801:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882615.084419:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563985664 00000100:00100000:0.0:1787882615.084428:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563985664 00000100:00100000:0.0:1787882615.084481:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563985408 00000100:00100000:0.0:1787882615.084484:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563985408 00000100:00100000:0.0:1787882615.084508:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787882615.084518:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563985664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882615.084588:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563985664:12345-0@lo:400:kworker.0 Request processed in 71us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882615.084595:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787882615.084622:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787882615.084628:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563985408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882615.084663:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563985408:12345-0@lo:400:kworker.0 Request processed in 35us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882615.084683:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787882615.084706:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563985152 00000100:00100000:0.0:1787882615.084709:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563985152 00000100:00100000:0.0:1787882615.084798:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563985280 00000100:00100000:0.0:1787882615.084803:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563985280 00000100:00100000:0.0:1787882615.084819:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563985536 00000100:00100000:0.0:1787882615.084822:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563985536 00000100:00100000:0.0:1787882615.084838:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787882615.084844:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563985152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882615.084912:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563985152:12345-0@lo:400:kworker.0 Request processed in 68us (2602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882615.084919:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787882615.084933:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787882615.084940:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563985280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882615.084981:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563985280:12345-0@lo:400:kworker.0 Request processed in 42us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882615.084987:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787882615.085000:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787882615.085006:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563985536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882615.085035:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563985536:12345-0@lo:400:kworker.0 Request processed in 29us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882615.085040:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1787882615.085058:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787882615.085063:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787882615.085065:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787882615.085661:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563985024 00000100:00100000:2.0:1787882615.085668:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563985024 00000100:00100000:2.0:1787882615.085699:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787882615.085706:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284bc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563985024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882615.085929:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284bc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563985024:12345-0@lo:400:kworker.0 Request processed in 223us (3178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882615.085936:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787882615.086302:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563985280:0@lo:400:kworker.0 00000100:00100000:2.0:1787882615.086316:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563985152:0@lo:400:kworker.0 00000100:00100000:2.0:1787882615.086328:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563985664:0@lo:400:kworker.0 00000100:00100000:2.0:1787882615.086351:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787882615.086360:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563985792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882615.086395:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882615.086668:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563985792 00000100:00100000:1.0:1787882615.086673:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563985792 00000100:00100000:1.0:1787882615.086711:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787882615.086725:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563985792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882615.086759:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882615.086797:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563985792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882615.086804:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787882615.086936:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563985536:0@lo:400:kworker.0 00010000:00080000:0.0:1787882615.086980:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2bf48e680 x1874730563985408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882615.086991:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563985408:0@lo:400:kworker.0 00000100:00100000:0.0:1787882615.087013:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563985024:0@lo:400:kworker.0 00010000:00080000:2.0:1787882615.087275:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1154e00 x1874730563985792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882615.087291:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563985792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882615.594767:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787882615.594792:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563985920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787882615.594905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882615.595201:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563985920 00000100:00100000:1.0:1787882615.595209:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563985920 00000100:00100000:1.0:1787882615.595267:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787882615.595277:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563985920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882615.595311:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882615.595355:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563985920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882615.595376:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787882615.595480:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563985920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787882615.915301:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882616.483615:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882616.483994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882616.484221:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541931776 00000100:00100000:1.0:1787882616.484231:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541931776 00000100:00100000:3.0:1787882616.484462:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541931648 00000100:00100000:3.0:1787882616.484467:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541931648 00000100:00100000:3.0:1787882616.484511:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 277 00000100:00100000:3.0:1787882616.484521:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541931648:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882616.484590:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541931648:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 70us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882616.484597:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 277 00000100:00100000:3.0:1787882616.484680:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882616.484754:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882616.484773:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541932032 00000100:00100000:3.0:1787882616.484777:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541932032 00000100:00100000:1.0:1787882616.484833:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 110 00000100:00100000:1.0:1787882616.484841:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2359:x1874730541931776:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882616.484919:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2359:x1874730541931776:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 79us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882616.484926:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 110 00000100:00100000:2.0:1787882616.485762:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541931904 00000100:00100000:2.0:1787882616.485770:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541931904 00000100:00080000:0.0:1787882616.487415:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787882616.487425:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882616.487678:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:2.0:1787882616.487692:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541931904:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882616.487767:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 111 00000100:00100000:2.0:1787882616.487768:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541931904:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 79us (3012us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882616.487775:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541932032:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882616.487775:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:3.0:1787882616.487804:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541932032:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (3125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882616.487810:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 111 00010000:00010000:2.0:1787882616.938226:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882617.962229:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882618.986090:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882620.018551:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882620.202254:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787882620.203534:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563986176:0@lo:400:kworker.0 00000100:00100000:2.0:1787882620.205002:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787882620.205030:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563986432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882620.205118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882620.205194:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563986432 00000100:00100000:2.0:1787882620.205213:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563986432 00000100:00100000:2.0:1787882620.205272:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787882620.205281:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563986432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787882620.205327:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787882620.205376:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563986432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882620.205383:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787882620.205410:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787882620.205441:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1402a00 x1874730563986432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882636 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882620.205459:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563986432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787882620.206233:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882620.206265:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787882620.206277:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563986304:0@lo:400:kworker.0 00000100:00100000:1.0:1787882620.206304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882620.206336:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563986176 00000100:00100000:1.0:1787882620.206342:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563986176 00000100:00100000:1.0:1787882620.206376:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563986304 00000100:00100000:1.0:1787882620.206379:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563986304 00000100:00100000:1.0:1787882620.206406:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787882620.206413:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563986176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882620.206462:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563986176:12345-0@lo:400:kworker.0 Request processed in 49us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882620.206468:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787882620.206497:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787882620.206503:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563986304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882620.206534:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563986304:12345-0@lo:400:kworker.0 Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882620.206550:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1787882620.206576:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882620.206701:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563986048:0@lo:400:kworker.0 00000100:00100000:3.0:1787882620.206743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882620.206752:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563986304:0@lo:400:kworker.0 00000100:00100000:1.0:1787882620.206770:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563986176:0@lo:400:kworker.0 00000100:00100000:3.0:1787882620.206829:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563986048 00000100:00100000:3.0:1787882620.206834:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563986048 00000100:00100000:3.0:1787882620.206902:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787882620.206910:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563986048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882620.206955:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563986048:12345-0@lo:400:kworker.0 Request processed in 46us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882620.206961:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1787882620.207003:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563986048:0@lo:400:kworker.0 00000100:00100000:0.0:1787882620.209852:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563986688:0@lo:400:kworker.0 00000100:00100000:0.0:1787882620.209968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882620.210428:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787882620.210442:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563986560:0@lo:400:kworker.0 00000100:00100000:3.0:1787882620.210479:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882620.210774:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563986688 00000100:00100000:2.0:1787882620.210783:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563986688 00000100:00100000:2.0:1787882620.210844:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787882620.210854:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563986688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882620.210947:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563986688:12345-0@lo:400:kworker.0 Request processed in 95us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882620.210954:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787882620.210987:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787882620.211024:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563986688:0@lo:400:kworker.0 00000100:00100000:1.0:1787882620.213040:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563986560 00000100:00100000:1.0:1787882620.213056:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563986560 00000100:00100000:1.0:1787882620.213338:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787882620.213350:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563986560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882620.213459:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563986560:12345-0@lo:400:kworker.0 Request processed in 111us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882620.213466:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787882620.213566:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563986560:0@lo:400:kworker.0 00000100:00080000:2.0:1787882620.214574:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882620.714308:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563986816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787882620.714894:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882620.717010:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563986816 00000100:00100000:3.0:1787882620.717023:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563986816 00000100:00100000:3.0:1787882620.717122:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787882620.717132:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563986816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787882620.717168:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882620.717257:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563986816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882620.717264:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787882620.717365:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563986816:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787882621.037322:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882621.601506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882621.601546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882621.601582:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882621.601620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882621.601681:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541932288 00000100:00100000:0.0:1787882621.601699:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541932288 00000100:00100000:3.0:1787882621.601795:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541932544 00000100:00100000:3.0:1787882621.601806:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541932544 00000100:00100000:0.0:1787882621.608497:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:0.0:1787882621.608518:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541932288:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882621.608608:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541932288:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 98us (7060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882621.608615:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:3.0:1787882621.608693:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:3.0:1787882621.608778:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541932544:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882621.608810:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541932544:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (7228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882621.609038:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00080000:3.0:1787882621.609070:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882621.609090:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541932160 00000100:00100000:3.0:1787882621.609096:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541932160 00000100:00100000:3.0:1787882621.609122:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 279 00000100:00100000:3.0:1787882621.609129:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541932160:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882621.609157:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541932160:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (7673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882621.609179:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 279 00000100:00100000:0.0:1787882621.617595:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541932416 00000100:00100000:0.0:1787882621.617609:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541932416 00000100:00080000:3.0:1787882621.617672:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787882621.617692:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:0.0:1787882621.617703:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2359:x1874730541932416:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882621.617782:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2359:x1874730541932416:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 78us (16159us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882621.617802:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00010000:00010000:1.0:1787882622.058032:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787882622.954549:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787882623.082104:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882624.106261:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882625.131765:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882625.322122:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563987072:0@lo:400:kworker.0 00000100:00100000:0.0:1787882625.322132:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563987328:0@lo:400:kworker.0 00000100:00100000:3.0:1787882625.322419:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563986944:0@lo:400:kworker.0 00000100:00100000:2.0:1787882625.326719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882625.326900:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563987584:0@lo:400:kworker.0 00000100:00100000:2.0:1787882625.326944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882625.327010:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563987584 00000100:00100000:2.0:1787882625.327015:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563987584 00000100:00100000:2.0:1787882625.327069:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787882625.327077:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563987584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882625.327126:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563987584:12345-0@lo:400:kworker.0 Request processed in 50us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882625.327147:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787882625.327190:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563987584:0@lo:400:kworker.0 00000100:00100000:2.0:1787882625.327251:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563987200:0@lo:400:kworker.0 00000100:00100000:2.0:1787882625.327274:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787882625.329317:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882625.329771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882625.329829:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563987456:0@lo:400:kworker.0 00000100:00100000:0.0:1787882625.330659:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882625.330773:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563987328 00000100:00100000:0.0:1787882625.330782:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563987328 00000100:00100000:0.0:1787882625.330837:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787882625.330846:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563987328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882625.330922:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563987328:12345-0@lo:400:kworker.0 Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882625.330929:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787882625.330959:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787882625.330987:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2c1156a00 x1874730563987328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882625.331001:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563987328:0@lo:400:kworker.0 00000100:00100000:0.0:1787882625.331040:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563986944 00000100:00100000:0.0:1787882625.331044:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563986944 00000100:00100000:0.0:1787882625.331070:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787882625.331077:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563986944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882625.331112:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730563986944:12345-0@lo:400:kworker.0 Request processed in 35us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882625.331118:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787882625.333060:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563987712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882625.333120:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882625.333172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882625.333262:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563987712 00000100:00100000:0.0:1787882625.333270:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563987712 00000100:00100000:0.0:1787882625.333313:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787882625.333321:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563987712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882625.333379:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882625.333426:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563987712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882625.333433:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787882625.334622:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563987072 00000100:00100000:1.0:1787882625.334633:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563987072 00000100:00100000:1.0:1787882625.335181:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563987200 00000100:00100000:1.0:1787882625.335186:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563987200 00000100:00080000:1.0:1787882625.335208:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882625.335316:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787882625.335328:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563987072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882625.335385:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787882625.335395:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563987200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882625.335446:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563987200:12345-0@lo:400:kworker.0 Request processed in 53us (8170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882625.335452:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563987072:12345-0@lo:400:kworker.0 Request processed in 124us (8740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882625.335458:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787882625.335467:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787882625.335529:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1157480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563987072:0@lo:400:kworker.0 00000100:00100000:3.0:1787882625.342143:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1155c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730563986944:0@lo:400:kworker.0 00000100:00100000:3.0:1787882625.342195:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563987200:0@lo:400:kworker.0 00010000:00080000:3.0:1787882625.342211:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2bf48e680 x1874730563987712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882625.342230:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563987712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882625.342789:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563987456 00000100:00100000:0.0:1787882625.342797:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563987456 00000100:00100000:0.0:1787882625.342979:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787882625.342989:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563987456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882625.343066:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730563987456:12345-0@lo:400:kworker.0 Request processed in 77us (9892us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882625.343073:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787882625.343176:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730563987456:0@lo:400:kworker.0 00000100:00080000:1.0:1787882625.343245:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882625.834465:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563987840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787882625.834544:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882625.835541:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563987840 00000100:00100000:2.0:1787882625.835552:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563987840 00000100:00100000:2.0:1787882625.835612:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787882625.835622:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563987840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787882625.835655:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787882625.835732:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1156a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563987840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882625.835739:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787882625.836168:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563987840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787882626.154032:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882626.721959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882626.722002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882626.722079:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541932672 00000100:00100000:3.0:1787882626.722088:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541932672 00000100:00100000:3.0:1787882626.722154:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 281 00000100:00100000:3.0:1787882626.722164:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541932672:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882626.722244:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541932672:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882626.722252:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 281 00000100:00100000:0.0:1787882626.722364:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541932800 00000100:00100000:0.0:1787882626.722368:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541932800 00000100:00100000:0.0:1787882626.722418:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:0.0:1787882626.722427:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2359:x1874730541932800:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882626.722459:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2359:x1874730541932800:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882626.722466:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00080000:3.0:1787882626.722541:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882626.755338:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882626.755392:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882626.755545:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541933056 00000100:00100000:1.0:1787882626.755555:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541933056 00000100:00100000:1.0:1787882626.755627:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:1.0:1787882626.755637:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541933056:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882626.755720:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541933056:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882626.755729:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00080000:3.0:1787882626.756301:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882626.756359:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541932928 00000100:00100000:0.0:1787882626.756365:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541932928 00000100:00100000:0.0:1787882626.756413:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:0.0:1787882626.756420:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2355:x1874730541932928:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:0.0:1787882626.756443:0:9930:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5def56 00000100:00080000:0.0:1787882626.756452:0:9930:0:(import.c:65:import_set_state_nolock()) ffff9fa2a04de000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787882626.756492:0:9930:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:3.0:1787882626.756885:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787882626.757054:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+2:2355:x1874730541932928:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 631us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882626.757063:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00010000:00010000:1.0:1787882626.757887:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882627.181231:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882628.202167:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882629.226031:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882630.250212:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882630.442823:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563987968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787882630.442973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882630.443115:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563987968 00000100:00100000:1.0:1787882630.443126:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563987968 00000100:00100000:1.0:1787882630.443203:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787882630.443215:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563987968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882630.443253:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882630.443334:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730563987968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882630.443342:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787882630.443374:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787882630.443473:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2a998fb80 x1874730563987968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882630.443493:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563987968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882630.445835:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563988224:0@lo:400:kworker.0 00000100:00100000:1.0:1787882630.445839:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563988352:0@lo:400:kworker.0 00000100:00100000:1.0:1787882630.449515:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563988096:0@lo:400:kworker.0 00000100:00100000:1.0:1787882630.449581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882630.449626:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563988608:0@lo:400:kworker.0 00000100:00100000:1.0:1787882630.449655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882630.449683:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787882630.449690:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563988480:0@lo:400:kworker.0 00000100:00100000:1.0:1787882630.449716:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882630.449858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882630.450181:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563988480 00000100:00100000:2.0:1787882630.450192:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563988480 00000100:00100000:2.0:1787882630.450330:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563988352 00000100:00100000:2.0:1787882630.450337:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563988352 00000100:00100000:3.0:1787882630.450410:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787882630.450426:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563988480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882630.450516:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563988480:12345-0@lo:400:kworker.0 Request processed in 94us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882630.450525:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1787882630.450605:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882630.450655:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563988480:0@lo:400:kworker.0 00000100:00100000:2.0:1787882630.450960:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787882630.450973:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563988352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882630.451344:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563988352:12345-0@lo:400:kworker.0 Request processed in 372us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882630.451376:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787882630.451435:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1155f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563988352:0@lo:400:kworker.0 00000100:00100000:1.0:1787882630.451972:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563988608 00000100:00100000:1.0:1787882630.451982:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563988608 00000100:00100000:0.0:1787882630.452946:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882630.453012:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563988224 00000100:00100000:0.0:1787882630.453017:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563988224 00000100:00100000:0.0:1787882630.453047:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787882630.453056:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563988224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882630.453095:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787882630.453106:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563988608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882630.453108:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563988224:12345-0@lo:400:kworker.0 Request processed in 54us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882630.453114:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787882630.453144:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563988608:12345-0@lo:400:kworker.0 Request processed in 41us (3489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882630.453150:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787882630.453167:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563988096 00000100:00100000:1.0:1787882630.453170:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563988096 00000100:00100000:1.0:1787882630.453191:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787882630.453196:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563988096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882630.453225:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563988096:12345-0@lo:400:kworker.0 Request processed in 29us (3645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882630.453230:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787882630.453276:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563988096:0@lo:400:kworker.0 00000100:00100000:1.0:1787882630.453302:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1157100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563988608:0@lo:400:kworker.0 00000100:00080000:3.0:1787882630.453392:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787882630.453527:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563988224:0@lo:400:kworker.0 00000001:00100000:1.0:1787882630.521287:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000020:00000080:1.0:1787882630.521295:0:7664:0:(genops.c:885:class_export_put()) final put ffff9fa2a04db800/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000020:00000080:1.0:1787882630.521319:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2a04db800/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 for lustre-OST0001 00000020:00000080:1.0:1787882630.521363:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2a04de000 for lustre-OST0001 00000100:00100000:0.0:1787882630.954005:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563988736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787882630.954100:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882630.954159:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563988736 00000100:00100000:1.0:1787882630.954167:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563988736 00000100:00100000:1.0:1787882630.954216:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787882630.954225:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563988736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882630.954258:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882630.954310:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1155500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563988736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882630.954316:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787882630.954614:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563988736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787882631.275202:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882631.846376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882631.846431:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882631.846469:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882631.846540:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541933440 00000100:00100000:0.0:1787882631.846555:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541933440 00000100:00100000:0.0:1787882631.846658:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541933312 00000100:00100000:1.0:1787882631.846660:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541933184 00000100:00100000:0.0:1787882631.846664:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541933312 00000100:00100000:1.0:1787882631.846672:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541933184 00000100:00100000:0.0:1787882631.846707:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:0.0:1787882631.846725:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541933440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882631.846734:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 283 00000100:00100000:1.0:1787882631.846748:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541933184:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882631.846823:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541933440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 103us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882631.846834:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:3.0:1787882631.846845:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 126 00000100:00100000:3.0:1787882631.846861:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541933312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:2.0:1787882631.846976:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882631.850125:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541933184:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3360us (3748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882631.850146:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 283 00000100:00100000:3.0:1787882631.852216:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2357:x1874730541933312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5343us (5727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882631.852235:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 126 00000040:00080000:1.0:1787882632.170496:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787882632.299284:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882633.323364:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787882634.026957:0:11862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:03:52 (1787882632) 00010000:00010000:1.0:1787882634.346138:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882635.370238:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882635.562277:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787882635.562318:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563988864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882635.562421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882635.562460:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563989120:0@lo:400:kworker.0 00000100:00100000:2.0:1787882635.562519:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882635.562524:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563989248:0@lo:400:kworker.0 00000100:00100000:2.0:1787882635.562548:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563989632:0@lo:400:kworker.0 00000100:00100000:0.0:1787882635.562560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882635.562586:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787882635.562587:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882635.562596:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563989376:0@lo:400:kworker.0 00000100:00100000:2.0:1787882635.562615:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787882635.562637:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563988992:0@lo:400:kworker.0 00000100:00100000:0.0:1787882635.562639:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882635.562686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882635.562690:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563988864 00000100:00100000:0.0:1787882635.562699:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563988864 00000100:00100000:2.0:1787882635.562720:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563989504:0@lo:400:kworker.0 00000100:00100000:2.0:1787882635.562745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882635.562775:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563989120 00000100:00100000:2.0:1787882635.562780:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563989120 00000100:00100000:2.0:1787882635.562834:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563989248 00000100:00100000:2.0:1787882635.562838:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563989248 00000100:00100000:0.0:1787882635.563095:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787882635.563107:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563988864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882635.563152:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882635.563190:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563988992 00000100:00100000:3.0:1787882635.563196:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563988992 00000100:00100000:0.0:1787882635.563212:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1157480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563988864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882635.563221:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787882635.563232:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787882635.563241:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563988992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882635.563266:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563989504 00000100:00100000:0.0:1787882635.563272:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563989504 00000100:00100000:3.0:1787882635.563300:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563988992:12345-0@lo:400:kworker.0 Request processed in 59us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882635.563308:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787882635.563346:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563989632 00000100:00100000:3.0:1787882635.563350:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563989632 00000100:00100000:2.0:1787882635.563553:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787882635.563561:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563989120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882635.563603:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563989120:12345-0@lo:400:kworker.0 Request processed in 43us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882635.563609:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787882635.563620:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563989248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882635.563658:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563989248:12345-0@lo:400:kworker.0 Request processed in 42us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882635.563665:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787882635.563699:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787882635.563706:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563989504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882635.564102:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563989504:12345-0@lo:400:kworker.0 Request processed in 395us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882635.564109:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787882635.564204:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563989376 00000100:00100000:3.0:1787882635.564210:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563989376 00000100:00100000:0.0:1787882635.564211:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563989248:0@lo:400:kworker.0 00010000:00080000:0.0:1787882635.564233:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2a998fb80 x1874730563988864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882635.564240:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787882635.564257:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563988864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882635.564384:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563989632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882635.564429:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563989632:12345-0@lo:400:kworker.0 Request processed in 50us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882635.564542:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787882635.564609:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563988992:0@lo:400:kworker.0 00000100:00100000:2.0:1787882635.565135:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563989504:0@lo:400:kworker.0 00000100:00100000:2.0:1787882635.565159:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563989120:0@lo:400:kworker.0 00000100:00100000:2.0:1787882635.565170:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563989632:0@lo:400:kworker.0 00000100:00100000:0.0:1787882635.566119:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787882635.566146:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563989376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882635.566329:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563989376:12345-0@lo:400:kworker.0 Request processed in 196us (3692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882635.566338:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787882635.566468:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa2bf3d6300 x1874730563989376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787882651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882635.566486:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563989376:0@lo:400:kworker.0 00000100:00100000:3.0:1787882635.566993:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1787882635.569638:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882635.569653:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787882635.569657:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882635.637306:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882635.637451:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541933568 00000100:00100000:0.0:1787882635.637464:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541933568 00000100:00100000:0.0:1787882635.637726:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:0.0:1787882635.637738:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:10257:x1874730541933568:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882635.637764:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1787882635.638094:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787882635.639097:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843023 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882635.639188:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df028 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882635.639202:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882635.639216:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882635.639900:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787882635.639906:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882635.641082:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882635.641132:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843023 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882635.641152:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df028 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843023 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882635.641161:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160200) 00010000:00010000:0.0:1787882635.641470:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787882635.641475:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8600, rc 0) 00000100:00100000:0.0:1787882635.642033:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:10257:x1874730541933568:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 4292us (4735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882635.642053:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:0.0:1787882635.646797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882635.647028:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541933696 00000100:00100000:2.0:1787882635.647046:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541933696 00000100:00100000:2.0:1787882635.647129:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:2.0:1787882635.647143:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:10258:x1874730541933696:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882635.647170:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882635.647197:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df02f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84302a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.647299:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df036 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.647317:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.647330:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.647349:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df03d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.647356:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df03d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.647385:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df03d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.647947:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5df044 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.647958:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5df044 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.647967:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5df044 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882635.648058:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787882635.648062:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882635.648165:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5df044 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648178:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df036 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648185:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df036 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648192:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df036 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648197:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882635.648202:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df036 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648210:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df036 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648231:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160200) 00010000:00010000:2.0:1787882635.648234:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882635.648240:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648246:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648258:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df03d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648264:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df03d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648269:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df03d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648274:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882635.648276:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df03d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648282:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df03d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648289:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fa285a00800) 00010000:00010000:2.0:1787882635.648291:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882635.648294:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df03d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648301:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df03d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648360:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df02f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84302a expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648375:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5df044 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84302a expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.648383:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa285a00b00) 00010000:00010000:2.0:1787882635.648385:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787882635.648388:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265400, rc 0) 00000100:00100000:2.0:1787882635.648478:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:10258:x1874730541933696:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1336us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882635.648488:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:3.0:1787882635.651279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882635.651342:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541933952 00000100:00100000:2.0:1787882635.651355:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541933952 00000100:00100000:2.0:1787882635.651424:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:2.0:1787882635.651435:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:10258:x1874730541933952:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882635.651462:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882635.651500:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df04b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843031 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.651595:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df052 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.651611:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df052 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882635.651624:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df052 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.652015:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df059 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.652042:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df059 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.652054:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df059 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.652626:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cea00/0xf4731e8a7c5df060 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.652636:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cea00/0xf4731e8a7c5df060 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.652642:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cea00/0xf4731e8a7c5df060 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882635.652653:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787882635.652995:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df052 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653003:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df052 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653018:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df052 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653024:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882635.653028:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df052 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653034:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df052 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653046:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa285a00b00) 00010000:00010000:3.0:1787882635.653048:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882635.653052:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df052 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653057:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df052 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653068:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df059 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653073:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df059 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653077:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df059 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653081:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882635.653083:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df059 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653094:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df059 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653101:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fa2a0727b00) 00010000:00010000:3.0:1787882635.653102:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882635.653105:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df059 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653110:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df059 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653520:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df04b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843031 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653535:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cea00/0xf4731e8a7c5df060 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843031 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882635.653541:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:3.0:1787882635.653543:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882635.653545:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cea00, rc 0) 00000100:00100000:3.0:1787882635.653660:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:10258:x1874730541933952:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 2226us (2396us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787882635.653669:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:1.0:1787882635.659610:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882635.660648:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541934080 00000100:00100000:3.0:1787882635.660665:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541934080 00000100:00100000:3.0:1787882635.660751:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:3.0:1787882635.660764:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:10258:x1874730541934080:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787882635.660972:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:10258:x1874730541934080:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 Request processed in 210us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882635.660981:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:0.0:1787882636.074199:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563989760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787882636.074297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882636.074438:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563989760 00000100:00100000:1.0:1787882636.074450:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563989760 00000100:00100000:1.0:1787882636.074515:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787882636.074526:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563989760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882636.074570:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882636.074630:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1155f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563989760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882636.074638:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787882636.074693:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563989760:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787882636.267525:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787882636.396301:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882636.961914:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882636.961971:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882636.962018:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882636.962072:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541934464 00000100:00100000:2.0:1787882636.962085:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541934464 00000100:00100000:2.0:1787882636.962170:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541934336 00000100:00100000:2.0:1787882636.962174:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541934336 00000100:00100000:3.0:1787882636.962177:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:3.0:1787882636.962190:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2356:x1874730541934464:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882636.962194:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00100000:2.0:1787882636.962200:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2356:x1874730541934336:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:0.0:1787882636.962282:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882636.962363:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2356:x1874730541934464:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 175us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882636.962371:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:1.0:1787882636.962489:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541934208 00000100:00100000:1.0:1787882636.962494:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541934208 00000100:00100000:1.0:1787882636.962536:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 285 00000100:00100000:1.0:1787882636.962544:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2356:x1874730541934208:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882636.967661:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2356:x1874730541934336:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5440us (5622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882636.967679:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00100000:1.0:1787882636.967837:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2356:x1874730541934208:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5291us (5972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882636.967859:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 285 00010000:00010000:1.0:1787882637.418153:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882637.827985:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882637.828125:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541934592 00000100:00100000:1.0:1787882637.828140:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541934592 00000100:00100000:1.0:1787882637.828229:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:1.0:1787882637.828243:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:10301:x1874730541934592:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1787882637.828273:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882637.828302:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5df06e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843038 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828416:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df075 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828435:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df075 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828449:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df075 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828467:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df07c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828475:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df07c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828482:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df07c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828848:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df075 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828859:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df075 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828866:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df075 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828904:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882637.828909:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df075 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828928:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df075 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828944:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160200) 00010000:00010000:1.0:1787882637.828948:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882637.828955:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df075 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828961:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df075 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828977:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df07c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828983:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df07c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828990:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df07c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.828996:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882637.828998:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df07c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.829005:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df07c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.829012:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fa283291000) 00010000:00010000:1.0:1787882637.829015:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882637.829018:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df07c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.829034:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df07c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.829078:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5df06e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843038 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.829091:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160200) 00010000:00010000:1.0:1787882637.829093:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882637.829097:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5df06e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843038 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.829107:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6000, rc 0) 00000100:00100000:1.0:1787882637.829203:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:10301:x1874730541934592:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 963us (1233us total) trans 0 rc 301/301 00000100:00100000:1.0:1787882637.829212:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00080000:0.0:1787882637.829644:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882637.833059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882637.833163:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541934848 00000100:00100000:3.0:1787882637.833176:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541934848 00000100:00100000:3.0:1787882637.833293:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:3.0:1787882637.833305:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:10301:x1874730541934848:12345-192.168.206.21@tcp:36:lfs.0 00010000:00010000:3.0:1787882637.833379:0:6733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882637.833416:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df028 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843023 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.833437:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa289160200) 00010000:00010000:3.0:1787882637.833466:0:6733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787882637.833858:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df083 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.833895:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df083 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.833909:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df083 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.833936:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df08a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.833944:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df08a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.833951:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df08a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882637.835624:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787882637.835646:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df083 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.835658:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df083 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.835666:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df083 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.835673:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cfa00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882637.835678:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df083 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.835687:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df083 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.835705:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727b00) 00010000:00010000:3.0:1787882637.835709:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882637.835713:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df083 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.835732:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df083 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787882637.835754:0:6733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1566a04 reply state 0000000067d2b456 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df08a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882637.835765:0:6733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787882637.836528:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:10301:x1874730541934848:12345-192.168.206.21@tcp:36:lfs.0 Request processed in 3215us (3473us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787882637.836541:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 37 00010000:00010000:3.0:1787882637.840727:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df08a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.840750:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df08a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.840758:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df08a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.840765:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882637.840771:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df08a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.840779:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df08a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.840799:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fa2a0727900) 00010000:00010000:3.0:1787882637.840803:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882637.840808:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df08a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882637.840849:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df08a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882637.952315:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882637.952609:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541934976 00000100:00100000:3.0:1787882637.952623:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541934976 00000100:00100000:3.0:1787882637.952700:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:3.0:1787882637.952712:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:10309:x1874730541934976:12345-192.168.206.21@tcp:101:lctl.0 00010000:00010000:3.0:1787882637.952742:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882637.952771:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df091 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84303f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.953191:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5df098 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.953210:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5df098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.953228:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5df098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882637.953312:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787882637.953316:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787882637.953369:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5df098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.953420:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df091 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84303f expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.953444:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5df098 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84303f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882637.953454:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:1.0:1787882637.953457:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787882637.953461:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6000, rc 0) 00000100:00100000:1.0:1787882637.953561:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:10309:x1874730541934976:12345-192.168.206.21@tcp:101:lctl.0 Request processed in 850us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882637.953570:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:0.0:1787882638.027284:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882638.027499:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541935104 00000100:00100000:2.0:1787882638.027513:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541935104 00000100:00100000:2.0:1787882638.027592:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:2.0:1787882638.027604:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:10315:x1874730541935104:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1787882638.027631:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882638.027660:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df09f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843046 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.027745:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df0a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.027761:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.027775:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.027792:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df0ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.027817:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df0ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.027825:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df0ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.027999:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df0b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028008:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028014:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882638.028050:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787882638.028054:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882638.028118:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028132:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028139:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df0a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028145:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028152:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882638.028156:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028173:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df0a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028187:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:2.0:1787882638.028191:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882638.028196:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df0a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028202:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df0a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028220:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df0ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028227:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df0ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028233:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df0ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028239:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882638.028242:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df0ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028248:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df0ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028255:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fa285a00000) 00010000:00010000:2.0:1787882638.028258:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882638.028261:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df0ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028277:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df0ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028323:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df09f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843046 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028337:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843046 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.028345:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:2.0:1787882638.028347:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787882638.028350:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264a00, rc 0) 00000100:00100000:2.0:1787882638.028437:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:10315:x1874730541935104:12345-192.168.206.21@tcp:101:bash.0 Request processed in 835us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882638.028446:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:3.0:1787882638.040791:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882638.040849:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541935360 00000100:00100000:3.0:1787882638.040860:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541935360 00000100:00100000:3.0:1787882638.040943:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:3.0:1787882638.040954:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:10315:x1874730541935360:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1787882638.040980:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882638.041005:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df0bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84304d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.041190:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df0c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.041206:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df0c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.041219:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df0c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.041253:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df0c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.041260:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.041267:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787882638.041859:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787882638.042086:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df0d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.042098:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.042108:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.042147:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df0c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.042154:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df0c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.042160:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df0c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.042166:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882638.042171:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df0c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.042190:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df0c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.042204:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:3.0:1787882638.042208:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882638.042213:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df0c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.042219:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df0c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787882638.042234:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae9e5740 reply state 00000000c3343412 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882638.042243:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787882638.042281:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df0bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84304d expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.042296:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84304d expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.042304:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa2a0727500) 00010000:00010000:3.0:1787882638.042306:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882638.042308:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cf400, rc 0) 00000100:00100000:3.0:1787882638.042404:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:10315:x1874730541935360:12345-192.168.206.21@tcp:101:bash.0 Request processed in 1448us (1625us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787882638.042414:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 40 00010000:00010000:3.0:1787882638.057958:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.057997:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df0c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.058005:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.058010:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882638.058015:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.058023:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df0c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.058042:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa2a0727b00) 00010000:00010000:3.0:1787882638.058046:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882638.058050:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df0c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.058056:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df0c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882638.058292:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882638.058394:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541935488 00000100:00100000:3.0:1787882638.058406:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541935488 00000100:00100000:3.0:1787882638.058449:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:3.0:1787882638.058460:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874730541935488:12345-192.168.206.21@tcp:8:bash.0 00010000:00080000:3.0:1787882638.058498:0:6711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:3.0:1787882638.058538:0:6711:0:(genops.c:1385:class_connect()) connect: client 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9, cookie 0xf4731e8a7c5df0de 00002000:00100000:3.0:1787882638.058553:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9/ffff9fa2b623d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787882638.058592:0:6711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787882638.058933:0:6711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787882638.058970:0:6711:0:(import.c:65:import_set_state_nolock()) ffff9fa2b623b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787882638.059052:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af848e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2355:x1874730541935488:12345-192.168.206.21@tcp:8:bash.0 Request processed in 591us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882638.059061:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:0.0:1787882638.066416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882638.066805:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541935616 00000100:00100000:3.0:1787882638.066820:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541935616 00000100:00100000:3.0:1787882638.066948:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:3.0:1787882638.066962:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:0:x1874730541935616:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1787882638.066985:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882638.067014:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df3e976b/0xf4731e8a7c5df0e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843054 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787882638.067052:0:6710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882638.067077:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1787882638.067083:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882638.067095:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df3e976b/0xf4731e8a7c5df0e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843054 expref: 7 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.067124:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df3e976b/0xf4731e8a7c5df0e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843054 expref: 7 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.067141:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cf000, rc 0) 00000100:00100000:3.0:1787882638.067218:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:0:x1874730541935616:12345-192.168.206.21@tcp:101:bash.0 Request processed in 260us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882638.067246:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00080000:0.0:1787882638.067917:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787882638.075430:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882638.077322:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541935744 00000100:00100000:1.0:1787882638.077341:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541935744 00000100:00100000:1.0:1787882638.077422:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:1.0:1787882638.077435:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:10315:x1874730541935744:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1787882638.077457:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882638.077483:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84305b expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882638.077522:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df3e976b/0xf4731e8a7c5df0e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843054 expref: 8 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882638.077532:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882638.077537:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882638.077544:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882638.077605:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df3e976b/0xf4731e8a7c5df0e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843054 expref: 8 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882638.077623:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df3e976b/0xf4731e8a7c5df0e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843054 expref: 8 pid: 6710 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882638.077641:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6711:1874730563989888:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882638.077766:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298be2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787882638.092401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882638.092445:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541935872 00000100:00100000:2.0:1787882638.092456:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541935872 00010000:00010000:2.0:1787882638.092506:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df3e976b/0xf4731e8a7c5df0e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843054 expref: 9 pid: 6710 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882638.092549:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:2.0:1787882638.092560:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2357:x1874730541935872:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882638.092580:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882638.092610:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df3e976b/0xf4731e8a7c5df0e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843054 expref: 9 pid: 6710 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.092642:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df3e976b/0xf4731e8a7c5df0e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843054 expref: 9 pid: 6710 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.092675:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882638.092681:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882638.092690:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.092701:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.092745:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 9 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882638.092762:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1874730563990016:192.168.206.21@tcp:105: 00000100:00100000:2.0:1787882638.092893:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa282b4a000 going to sleep for 11 seconds 00010000:00010000:3.0:1787882638.098419:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df3e976b/0xf4731e8a7c5df0e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843054 expref: 9 pid: 6710 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882638.098447:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6711:1874730563989888:192.168.206.21@tcp:104: 00010000:00010000:3.0:1787882638.098486:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.098506:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa7a00, rc 0) 00000100:00100000:3.0:1787882638.098581:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:10315:x1874730541935744:12345-192.168.206.21@tcp:101:bash.0 Request processed in 21148us (23167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882638.098591:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:1.0:1787882638.103123:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882638.103237:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541936128 00000100:00100000:3.0:1787882638.103250:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541936128 00000100:00100000:3.0:1787882638.103325:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:3.0:1787882638.103338:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:10315:x1874730541936128:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:3.0:1787882638.103802:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:10315:x1874730541936128:12345-192.168.206.21@tcp:35:bash.0 Request processed in 465us (694us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787882638.103811:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:2.0:1787882638.105500:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da94000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1874730563990016:192.168.206.21@tcp:105: 00010000:00010000:2.0:1787882638.105533:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882638.105607:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541935872:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 13047us (13220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882638.105619:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:1.0:1787882638.214004:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882638.214250:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541936384 00000100:00100000:2.0:1787882638.214263:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541936384 00000100:00100000:2.0:1787882638.214340:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:2.0:1787882638.214371:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:10325:x1874730541936384:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882638.214405:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882638.214429:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df0f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843062 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882638.214581:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787882638.215174:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df0f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843062 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.215193:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:2.0:1787882638.215196:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787882638.215213:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df0f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843062 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.215232:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264e00, rc 0) 00000100:00100000:2.0:1787882638.215314:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:10325:x1874730541936384:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 945us (1323us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787882638.215322:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:3.0:1787882638.222425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882638.222547:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541936640 00000100:00100000:0.0:1787882638.222560:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541936640 00000100:00100000:0.0:1787882638.222637:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1787882638.222650:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:10325:x1874730541936640:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1787882638.223061:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:10325:x1874730541936640:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 412us (651us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787882638.223069:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1787882638.299067:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882638.299232:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541936768 00000100:00100000:3.0:1787882638.299246:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541936768 00000100:00100000:3.0:1787882638.299327:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:3.0:1787882638.299340:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:10331:x1874730541936768:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882638.299381:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882638.299407:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843069 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.299507:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.299525:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.299538:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882638.299619:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787882638.299623:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882638.299651:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.299702:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843069 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.299726:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843069 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.299737:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:3.0:1787882638.299740:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787882638.299744:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cee00, rc 0) 00000100:00100000:3.0:1787882638.299827:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10331:x1874730541936768:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 489us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882638.299845:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:2.0:1787882638.303686:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882638.303816:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541937024 00000100:00100000:0.0:1787882638.303829:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541937024 00000100:00100000:0.0:1787882638.303963:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:0.0:1787882638.303977:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10331:x1874730541937024:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1787882638.304021:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882638.304049:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df10f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843070 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.304198:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df116 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.304220:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.304234:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df116 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882638.304248:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787882638.304417:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df10f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843070 expref: 20 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.304438:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df116 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843070 expref: 19 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.304447:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa2a0727500) 00010000:00010000:0.0:1787882638.304451:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882638.304454:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8000, rc 0) 00000100:00100000:0.0:1787882638.304538:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10331:x1874730541937024:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 564us (868us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787882638.304546:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:0.0:1787882638.308764:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882638.309277:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882638.309578:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541937408 00000100:00100000:3.0:1787882638.309592:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541937408 00000100:00100000:3.0:1787882638.309674:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:3.0:1787882638.309688:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10331:x1874730541937408:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882638.309723:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882638.309749:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df124 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843077 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882638.310357:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541937280 00000100:00100000:2.0:1787882638.310366:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541937280 00010000:00010000:3.0:1787882638.312069:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df12b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.312098:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df12b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.312114:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df12b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882638.312134:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787882638.312338:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df124 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843077 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.312363:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df12b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843077 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.312373:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa2a0727500) 00010000:00010000:3.0:1787882638.312377:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787882638.312381:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67ce400, rc 0) 00000100:00100000:2.0:1787882638.312642:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:3.0:1787882638.312645:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:10331:x1874730541937408:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 2959us (3369us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787882638.312660:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:2358:x1874730541937280:12345-192.168.206.21@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787882638.312673:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00010000:00010000:2.0:1787882638.312677:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882638.312695:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df116 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843070 expref: 21 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.312899:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa2a0727500) 00010000:00010000:2.0:1787882638.312903:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882638.312927:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:2358:x1874730541937280:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 275us (4181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882638.312933:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:1.0:1787882638.320183:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882638.320538:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541937536 00000100:00100000:3.0:1787882638.320553:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541937536 00000100:00100000:3.0:1787882638.320772:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:3.0:1787882638.320785:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2359:x1874730541937536:12345-192.168.206.21@tcp:1:lfs.0 00010000:00010000:3.0:1787882638.320853:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.320914:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.320925:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882638.320930:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787882638.320935:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.321008:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.321026:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 7 pid: 6711 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882638.321044:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6710:1874730563990144:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882638.321155:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b717f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787882638.324528:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882638.324832:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541937664 00000100:00100000:2.0:1787882638.324852:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541937664 00002000:00100000:2.0:1787882638.324921:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9fa29da93800 x1874730541937664/t0(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:369/0 lens 504/0 e 0 to 0 dl 1787882649 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787882638.324932:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa29da93800 with x1874730541937664 ext(0->12) 00010000:00010000:2.0:1787882638.324942:0:6714:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 8 pid: 6711 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.324959:0:6714:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 8 pid: 6711 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882638.324969:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa29da93800 00000100:00100000:2.0:1787882638.325056:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:2.0:1787882638.325068:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730541937664:12345-192.168.206.21@tcp:4:lfs.0 00000100:00100000:3.0:1787882638.325377:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6710:1874730563990144:192.168.206.21@tcp:104: 00010000:00010000:3.0:1787882638.325429:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787882638.397625:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000100:00100000:3.0:1787882638.399800:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2356:x1874730541937664:12345-192.168.206.21@tcp:4:lfs.0 Request processed in 74727us (75273us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787882638.399818:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00002000:00100000:3.0:1787882638.399831:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9fa29da93800 x1874730541937664/t4294967299(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:369/0 lens 504/448 e 0 to 0 dl 1787882649 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787882638.399851:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa29da93800 with x1874730541937664 ext(0->12) 00010000:00010000:3.0:1787882638.399863:0:6714:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 9 pid: 6711 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.399903:0:6714:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 9 pid: 6711 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787882638.399910:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa29da93800 00000100:00100000:0.0:1787882638.413240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882638.417219:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541937792 00000100:00100000:3.0:1787882638.417233:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541937792 00010000:00010000:3.0:1787882638.417281:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 9 pid: 6711 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882638.417347:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:3.0:1787882638.417357:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2358:x1874730541937792:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882638.417854:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787882638.418004:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787882638.418008:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787882637 00002000:00010000:3.0:1787882638.418010:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787882637 00002000:00010000:3.0:1787882638.418013:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787882637 00010000:00010000:3.0:1787882638.418021:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 9 pid: 6711 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.418036:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 9 pid: 6711 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.418059:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5df0ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84305b expref: 9 pid: 6711 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.418074:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787882638.418078:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787882638.418084:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.418456:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.418498:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787882638.418636:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.418647:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.418684:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.418693:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882638.419997:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2358:x1874730541937792:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 2632us (6757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882638.420009:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00010000:00010000:2.0:1787882638.420387:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.420400:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cfa00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882638.420405:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.420414:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.420431:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.420439:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df139 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882638.420507:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2359:x1874730541937536:12345-192.168.206.21@tcp:1:lfs.0 Request processed in 99725us (100338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882638.420514:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:1.0:1787882638.423495:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882638.423697:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541938048 00000100:00100000:0.0:1787882638.423817:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541938048 00000100:00100000:0.0:1787882638.427922:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1787882638.427944:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:10331:x1874730541938048:12345-192.168.206.21@tcp:35:lfs.0 00000004:00010000:0.0:1787882638.428004:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df12b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843077 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787882638.428338:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787882638.428402:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787882638.429410:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787882638.429472:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.429489:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df0d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84304d expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.429498:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.429533:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84304d expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.429549:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df0d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84304d expref: 24 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882638.429567:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1874730563990272:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882638.436423:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a02c7780 going to sleep for 11 seconds 00000100:00100000:1.0:1787882638.442296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:1.0:1787882638.442389:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882638.442483:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541938176 00000100:00100000:2.0:1787882638.442492:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541938176 00010000:00010000:2.0:1787882638.442532:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df0d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84304d expref: 25 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882638.442580:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:2.0:1787882638.442591:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+25:2356:x1874730541938176:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882638.442606:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882638.442613:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df0d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84304d expref: 25 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.442627:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df0d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84304d expref: 25 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.442650:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa2a0727500) 00010000:00010000:2.0:1787882638.442656:0:8466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.442666:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.442674:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.442691:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882638.442765:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+25:2356:x1874730541938176:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 174us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882638.442777:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 37 00010000:00010000:0.0:1787882638.444928:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df0d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84304d expref: 24 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882638.444972:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1874730563990272:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882638.444998:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.445079:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.445104:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882638.445219:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787882638.445449:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787882638.445579:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da96680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874730563990400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787882638.445681:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882638.446006:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563990400 00000100:00100000:0.0:1787882638.446014:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563990400 00000100:00100000:0.0:1787882638.446063:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882638.446071:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1874730563990400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787882638.446189:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa282b4a900 going to sleep for 11 seconds 00000100:00080000:3.0:1787882638.446306:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882638.449072:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1874730563990400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 2993us (3383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882638.449163:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882638.449277:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da96680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874730563990400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787882638.450821:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787882638.451305:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da96680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874730563990528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787882638.452557:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882638.452659:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287e00e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787882638.452787:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563990528 00000100:00100000:3.0:1787882638.452807:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563990528 00000100:00100000:3.0:1787882638.452939:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787882638.452951:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874730563990528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787882638.453574:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1874730563990528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 624us (1020us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787882638.453582:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882638.453678:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da96680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874730563990528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787882638.453777:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1787882638.453824:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.453845:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.453854:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.453860:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882638.453865:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.453895:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.453921:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa2a0727500) 00010000:00010000:0.0:1787882638.453924:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787882638.453929:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.453940:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df140 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787882638.454145:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787882638.454393:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787882638.454404:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354603533317ns, next at 355603531545ns, rc = 0 00000001:00080000:0.0:1787882638.454411:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787882638.454449:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa2a0727500) 00010000:00010000:0.0:1787882638.454453:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787882638.454460:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df12b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843077 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882638.454572:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:10331:x1874730541938048:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 26637us (31083us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787882638.454581:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000020:00080000:0.0:1787882638.454585:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787882638.457421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882638.457511:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541938304 00000100:00100000:0.0:1787882638.457520:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541938304 00000100:00100000:0.0:1787882638.457603:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:0.0:1787882638.457624:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:10331:x1874730541938304:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1787882638.457647:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882638.457669:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5df147 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84307e expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.457765:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5df147 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84307e expref: 28 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.457780:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5df147 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84307e expref: 28 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.457801:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:0.0:1787882638.457804:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787882638.457808:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8200, rc 0) 00000100:00100000:0.0:1787882638.457894:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:10331:x1874730541938304:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 272us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882638.457901:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:1.0:1787882638.464636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882638.465292:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541938560 00000100:00100000:3.0:1787882638.465303:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541938560 00000100:00100000:2.0:1787882638.465510:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:2.0:1787882638.465522:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa288323c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:10331:x1874730541938560:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1787882638.466012:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa288323c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:10331:x1874730541938560:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 489us (1383us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787882638.466020:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:1.0:1787882638.568346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882638.568534:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541938816 00000100:00100000:3.0:1787882638.568544:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541938816 00000100:00100000:3.0:1787882638.568651:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:3.0:1787882638.568662:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:10341:x1874730541938816:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882638.568687:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882638.568708:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df14e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843085 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882638.568848:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787882638.569012:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df14e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843085 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.569026:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:3.0:1787882638.569029:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787882638.569035:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df14e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843085 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882638.569048:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cf000, rc 0) 00000100:00100000:3.0:1787882638.569112:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:10341:x1874730541938816:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 452us (775us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787882638.569136:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:1.0:1787882638.573099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882638.574754:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541938944 00000100:00100000:2.0:1787882638.574767:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541938944 00000100:00100000:2.0:1787882638.574841:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:2.0:1787882638.574851:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:10341:x1874730541938944:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:2.0:1787882638.574963:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df15c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.574990:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df15c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575001:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df15c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575015:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575023:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575029:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575113:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df16a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575121:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df16a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575127:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df16a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787882638.575161:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df16a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575172:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df15c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575178:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df15c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575195:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df15c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575201:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882638.575206:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df15c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575213:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df15c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575223:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:2.0:1787882638.575226:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882638.575229:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df15c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575235:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df15c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575246:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575252:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575258:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575263:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882638.575265:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575279:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575286:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa285a00800) 00010000:00010000:2.0:1787882638.575288:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882638.575291:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df163 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575296:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575312:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df16a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575319:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df16a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575325:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df16a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575329:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882638.575332:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df16a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575337:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df16a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575342:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:2.0:1787882638.575344:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882638.575347:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df16a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.575360:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df16a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882638.576495:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:10341:x1874730541938944:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 1637us (3397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882638.576508:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:1.0:1787882638.581958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882638.582106:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541939200 00000100:00100000:0.0:1787882638.582116:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541939200 00000100:00100000:0.0:1787882638.582170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:0.0:1787882638.582180:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:10341:x1874730541939200:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1787882638.582424:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:10341:x1874730541939200:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 245us (474us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787882638.582432:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:1.0:1787882638.648161:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882638.652477:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541939456 00000100:00100000:2.0:1787882638.652491:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541939456 00000100:00100000:2.0:1787882638.652619:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:2.0:1787882638.652639:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:10344:x1874730541939456:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882638.652672:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882638.652691:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df171 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84308c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.652764:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df178 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.653851:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.653866:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.653898:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df17f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.653906:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df17f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.653929:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df17f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654061:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654070:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654077:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882638.654087:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787882638.654178:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654186:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df178 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654192:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df178 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654197:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882638.654201:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df178 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654208:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df178 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654221:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:2.0:1787882638.654224:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882638.654235:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654241:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654254:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df17f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654260:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df17f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654265:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df17f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654269:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882638.654272:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df17f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654276:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df17f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654283:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa285a00800) 00010000:00010000:2.0:1787882638.654286:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882638.654288:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df17f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654293:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df17f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654338:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df171 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84308c expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654363:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84308c expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882638.654370:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:2.0:1787882638.654372:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787882638.654374:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264800, rc 0) 00000100:00100000:2.0:1787882638.654445:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:10344:x1874730541939456:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1807us (6293us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787882638.654453:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:1.0:1787882638.661586:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882638.661814:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541939584 00000100:00100000:0.0:1787882638.661823:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541939584 00000100:00100000:0.0:1787882638.661903:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:0.0:1787882638.661914:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:10344:x1874730541939584:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:0.0:1787882638.662339:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.662372:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.662384:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.662410:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.662417:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df194 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.662425:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.662431:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882638.662435:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.662443:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df194 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.662454:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:0.0:1787882638.662457:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787882638.662461:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df194 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882638.662467:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df194 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882638.662582:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:10344:x1874730541939584:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 669us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882638.662596:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:1.0:1787882638.669056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882638.669141:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541939840 00000100:00100000:0.0:1787882638.669151:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541939840 00000100:00100000:0.0:1787882638.669203:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1787882638.669213:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:10344:x1874730541939840:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1787882638.669475:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:10344:x1874730541939840:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 262us (425us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787882638.669482:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:1.0:1787882639.044669:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882639.044952:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541940096 00000100:00100000:3.0:1787882639.044962:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541940096 00000100:00100000:3.0:1787882639.045046:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:3.0:1787882639.045059:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:10375:x1874730541940096:12345-192.168.206.21@tcp:101:cat.0 00000100:00080000:0.0:1787882639.045068:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787882639.045082:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882639.045103:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df19b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843093 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.045209:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.045223:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.045236:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882639.045246:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787882639.045382:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df19b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843093 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.045401:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843093 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.045409:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:3.0:1787882639.045412:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882639.045415:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67ce000, rc 0) 00000100:00100000:3.0:1787882639.045486:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:10375:x1874730541940096:12345-192.168.206.21@tcp:101:cat.0 Request processed in 430us (826us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787882639.045494:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:1.0:1787882639.066291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882639.066351:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882639.066429:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541940480 00000100:00100000:3.0:1787882639.066437:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541940480 00000100:00100000:3.0:1787882639.066493:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1787882639.066511:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:10375:x1874730541940480:12345-192.168.206.21@tcp:35:cat.0 00000100:00100000:3.0:1787882639.067132:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:10375:x1874730541940480:12345-192.168.206.21@tcp:35:cat.0 Request processed in 628us (778us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787882639.067142:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:2.0:1787882639.067228:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541940224 00000100:00100000:2.0:1787882639.067234:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541940224 00000100:00100000:2.0:1787882639.067279:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:2.0:1787882639.067287:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286601850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:2357:x1874730541940224:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882639.067298:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882639.067321:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843093 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.067338:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:2.0:1787882639.067344:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882639.067368:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286601850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:2357:x1874730541940224:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 82us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882639.067374:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:1.0:1787882639.146018:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882639.146216:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541940736 00000100:00100000:2.0:1787882639.146226:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541940736 00000100:00100000:2.0:1787882639.146285:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:2.0:1787882639.146310:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:10381:x1874730541940736:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1787882639.146333:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882639.146336:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787882639.146362:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df108 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843069 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.146378:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:2.0:1787882639.146383:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787882639.146396:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df1b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84309a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.146484:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.146497:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df186 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84308c expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.146505:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.146540:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84308c expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.146554:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84308c expref: 36 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882639.146568:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563990656:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882639.147214:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287e00840 going to sleep for 11 seconds 00000100:00100000:2.0:1787882639.151095:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da95180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563990656:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882639.151124:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882639.151338:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882639.151672:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541940864 00000100:00100000:2.0:1787882639.151679:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541940864 00010000:00010000:2.0:1787882639.151729:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84308c expref: 37 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882639.151766:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:2.0:1787882639.151774:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:2356:x1874730541940864:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882639.151789:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882639.151795:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84308c expref: 37 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.151807:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84308c expref: 37 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.151828:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84308c expref: 37 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.151855:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:2.0:1787882639.151860:0:8466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.151895:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.151904:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.151947:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882639.151992:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:2356:x1874730541940864:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 218us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882639.151999:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00010000:00010000:0.0:1787882639.152124:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.152132:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882639.152150:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787882639.152308:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df1b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84309a expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.152324:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84309a expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.152332:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:0.0:1787882639.152334:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787882639.152337:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264e00, rc 0) 00000100:00100000:0.0:1787882639.152361:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:10381:x1874730541940736:12345-192.168.206.21@tcp:101:dd.0 Request processed in 6054us (6353us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787882639.152377:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:1.0:1787882639.156234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882639.156347:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541941120 00000100:00100000:3.0:1787882639.156356:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541941120 00000100:00100000:3.0:1787882639.156405:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:3.0:1787882639.156415:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:10381:x1874730541941120:12345-192.168.206.21@tcp:36:dd.0 00010000:00010000:3.0:1787882639.156667:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.156685:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.156697:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787882639.156781:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787882639.156808:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e48488c4 reply state 00000000b728d1a5 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882639.156817:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787882639.156942:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+39:10381:x1874730541941120:12345-192.168.206.21@tcp:36:dd.0 Request processed in 527us (716us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787882639.156955:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00000020:00080000:3.0:1787882639.156959:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787882639.163304:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.163322:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.163330:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.163336:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882639.163340:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.163348:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.163365:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:2.0:1787882639.163368:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882639.163373:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.163379:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.466274:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882639.509957:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882639.511207:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541941248 00000100:00100000:3.0:1787882639.511219:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541941248 00000100:00100000:3.0:1787882639.511280:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:3.0:1787882639.511290:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:10395:x1874730541941248:12345-192.168.206.21@tcp:101:stat.0 00010000:00010000:3.0:1787882639.511314:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882639.511335:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430a1 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.511397:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df1d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.511411:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.511421:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.511434:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.511440:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.511447:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.511535:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.511564:0:6733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84309a expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.511572:0:6733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.511605:0:6733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84309a expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.511619:0:6733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84309a expref: 39 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882639.511633:0:6733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730563990784:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882639.511727:0:6733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b717f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787882639.516210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882639.516337:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541941504 00000100:00100000:0.0:1787882639.516346:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541941504 00000100:00100000:0.0:1787882639.516399:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:0.0:1787882639.516410:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+40:5609:x1874730541941504:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787882639.516744:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:5609:x1874730541941504:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 335us (542us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787882639.516751:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:3.0:1787882639.518255:0:6733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730563990784:192.168.206.21@tcp:104: 00010000:00010000:3.0:1787882639.518285:0:6733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882639.520573:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882639.520682:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541941632 00000100:00100000:2.0:1787882639.520714:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541941632 00010000:00010000:2.0:1787882639.520751:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84309a expref: 41 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882639.520792:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:2.0:1787882639.520801:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:2356:x1874730541941632:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882639.520818:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882639.520825:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84309a expref: 41 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.520848:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84309a expref: 41 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.520901:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df1b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84309a expref: 41 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.520917:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:2.0:1787882639.520922:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.520932:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.520939:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.520988:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882639.521040:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+40:2356:x1874730541941632:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 239us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882639.521057:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00010000:00010000:0.0:1787882639.521347:0:6733:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521355:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882639.521400:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787882639.521405:0:6733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882639.521443:0:6733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521456:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521465:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521471:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df1d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521477:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521489:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cee00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882639.521494:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521501:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df1d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521511:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:0.0:1787882639.521514:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882639.521518:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df1d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521524:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df1d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521537:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521542:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521548:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521552:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882639.521555:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521561:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521578:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa2a0727f00) 00010000:00010000:0.0:1787882639.521580:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882639.521583:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521589:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df1da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521624:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df1cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a1 expref: 40 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521637:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a1 expref: 39 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.521643:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:0.0:1787882639.521646:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882639.521648:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67ce400, rc 0) 00000100:00100000:0.0:1787882639.521675:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+39:10395:x1874730541941248:12345-192.168.206.21@tcp:101:stat.0 Request processed in 10387us (11728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882639.521682:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:1.0:1787882639.658381:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882639.658470:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541941888 00000100:00100000:3.0:1787882639.658481:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541941888 00000100:00100000:3.0:1787882639.658542:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:3.0:1787882639.658552:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+39:10401:x1874730541941888:12345-192.168.206.21@tcp:36:truncate.0 00010000:00010000:3.0:1787882639.658615:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882639.658641:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df1e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a1 expref: 39 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.658676:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:3.0:1787882639.658681:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787882639.658925:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df1e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.658938:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.658946:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787882639.659586:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787882639.659674:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8d2a42e reply state 00000000de043359 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882639.659684:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787882639.660242:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:10401:x1874730541941888:12345-192.168.206.21@tcp:36:truncate.0 Request processed in 1687us (1867us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787882639.660251:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00000020:00080000:3.0:1787882639.660257:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787882639.666231:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df1e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.666250:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df1e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.666257:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df1e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.666263:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882639.666284:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df1e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.666294:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df1e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.666313:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:3.0:1787882639.666317:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882639.666322:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df1e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882639.666328:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df1e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882639.844662:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882639.844759:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541942016 00000100:00100000:0.0:1787882639.844769:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541942016 00000100:00100000:0.0:1787882639.844844:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:0.0:1787882639.844855:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+40:10415:x1874730541942016:12345-192.168.206.21@tcp:101:stat.0 00010000:00010000:0.0:1787882639.844905:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882639.844926:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df1ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430a8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845023:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df1f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845035:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845045:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845057:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df1fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845062:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df1fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845067:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df1fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845156:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845164:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845171:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882639.845201:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787882639.845205:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882639.845221:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845242:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845251:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845257:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df1f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845264:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df1f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845269:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882639.845273:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df1f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845280:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df1f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845291:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:0.0:1787882639.845293:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882639.845297:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df1f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845303:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df1f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845315:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df1fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845320:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df1fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845332:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df1fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845337:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882639.845340:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df1fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845346:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df1fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845354:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa289160600) 00010000:00010000:0.0:1787882639.845356:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882639.845359:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df1fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845364:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df1fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845417:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df1ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a8 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845429:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a8 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882639.845435:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:0.0:1787882639.845437:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882639.845439:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9a00, rc 0) 00000100:00100000:0.0:1787882639.845485:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:10415:x1874730541942016:12345-192.168.206.21@tcp:101:stat.0 Request processed in 632us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882639.845848:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:1.0:1787882639.928704:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882639.929158:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541942272 00000100:00100000:2.0:1787882639.929168:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541942272 00000100:00100000:2.0:1787882639.929222:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:2.0:1787882639.929232:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:10425:x1874730541942272:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882639.929250:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882639.929269:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df20b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430af expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882639.929381:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787882639.929522:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df20b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430af expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.929535:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:2.0:1787882639.929538:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787882639.929543:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df20b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430af expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882639.929556:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264e00, rc 0) 00000100:00100000:2.0:1787882639.929618:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+42:10425:x1874730541942272:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 387us (932us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787882639.929625:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:1.0:1787882639.938451:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882639.938629:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541942528 00000100:00100000:0.0:1787882639.938638:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541942528 00000100:00100000:0.0:1787882639.938688:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:0.0:1787882639.938705:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+42:10425:x1874730541942528:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1787882639.939525:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+43:10425:x1874730541942528:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 815us (1076us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787882639.939535:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:1.0:1787882640.037064:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882640.037165:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541942784 00000100:00100000:3.0:1787882640.037175:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541942784 00000100:00100000:3.0:1787882640.037236:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:3.0:1787882640.037246:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+43:10431:x1874730541942784:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1787882640.037270:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882640.037292:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df219 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430b6 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.037390:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.037404:0:6733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a8 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.037412:0:6733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.037458:0:6733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a8 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.037471:0:6733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a8 expref: 44 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882640.037484:0:6733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730563990912:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882640.037592:0:6733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b717f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787882640.045050:0:6733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730563990912:192.168.206.21@tcp:104: 00010000:00010000:3.0:1787882640.045082:0:6733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882640.046843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882640.047076:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541942912 00000100:00100000:2.0:1787882640.047085:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541942912 00010000:00010000:2.0:1787882640.047123:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a8 expref: 45 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882640.047190:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:2.0:1787882640.047200:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+45:2357:x1874730541942912:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882640.047216:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882640.047224:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a8 expref: 45 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.047237:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a8 expref: 45 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.047260:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df204 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430a8 expref: 45 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.047277:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:2.0:1787882640.047282:0:8466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.047291:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.047297:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.047327:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882640.047375:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+44:2357:x1874730541942912:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 176us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882640.047383:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 40 00010000:00010000:0.0:1787882640.048093:0:6733:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.048104:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882640.048122:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787882640.048284:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df219 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430b6 expref: 45 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.048301:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430b6 expref: 44 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.048309:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:0.0:1787882640.048312:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787882640.048314:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67ce400, rc 0) 00000100:00100000:0.0:1787882640.048360:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+44:10431:x1874730541942784:12345-192.168.206.21@tcp:101:bash.0 Request processed in 11115us (11304us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787882640.048367:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:1.0:1787882640.059788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882640.062840:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541943168 00000100:00100000:2.0:1787882640.062922:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541943168 00000100:00100000:2.0:1787882640.063036:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:2.0:1787882640.063047:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+44:10431:x1874730541943168:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:2.0:1787882640.063313:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df22e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.063330:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df22e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.063342:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df22e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882640.063390:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787882640.063415:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dde485b8 reply state 00000000c34ea0d9 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df22e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882640.063424:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787882640.063525:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+47:10431:x1874730541943168:12345-192.168.206.21@tcp:36:bash.0 Request processed in 478us (3745us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787882640.063533:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00000020:00080000:2.0:1787882640.063537:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787882640.071451:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df22e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.071470:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df22e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.071478:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df22e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.071612:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882640.071627:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df22e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.071636:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df22e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.071653:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:3.0:1787882640.071673:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882640.071679:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df22e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.071686:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df22e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882640.072947:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882640.073336:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541943296 00000100:00100000:0.0:1787882640.073346:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541943296 00000100:00100000:0.0:1787882640.073400:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:0.0:1787882640.073410:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+46:10431:x1874730541943296:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1787882640.073432:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882640.073453:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df235 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430bd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.073612:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df23c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.073625:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430b6 expref: 47 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.073633:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df23c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.073665:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430b6 expref: 47 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.073678:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430b6 expref: 47 pid: 6733 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882640.073691:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563991040:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882640.074112:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a02c73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882640.076326:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563991040:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882640.076353:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df23c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882640.081071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882640.081451:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541943424 00000100:00100000:2.0:1787882640.081462:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541943424 00010000:00010000:2.0:1787882640.081510:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430b6 expref: 48 pid: 6733 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882640.081550:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:2.0:1787882640.081560:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+48:2357:x1874730541943424:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882640.081574:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882640.081581:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430b6 expref: 48 pid: 6733 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.081617:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430b6 expref: 48 pid: 6733 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.081636:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df220 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430b6 expref: 48 pid: 6733 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.081651:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:2.0:1787882640.081656:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df23c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.081665:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.081672:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df23c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.081856:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787882640.081963:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.081971:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882640.082014:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787882640.082017:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882640.082036:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.082068:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df235 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430bd expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.082082:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df23c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430bd expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.082089:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:0.0:1787882640.082092:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882640.082095:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8800, rc 0) 00000100:00100000:0.0:1787882640.082154:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+47:10431:x1874730541943296:12345-192.168.206.21@tcp:101:bash.0 Request processed in 8745us (9213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882640.082162:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:2.0:1787882640.082229:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+46:2357:x1874730541943424:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 671us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882640.082236:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:2.0:1787882640.091998:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882640.092211:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541943680 00000100:00100000:3.0:1787882640.092222:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541943680 00000100:00100000:3.0:1787882640.092276:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:3.0:1787882640.092286:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa288320c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+46:10431:x1874730541943680:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:3.0:1787882640.092507:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa288320c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+47:10431:x1874730541943680:12345-192.168.206.21@tcp:35:bash.0 Request processed in 222us (519us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787882640.092515:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:1.0:1787882640.211479:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882640.211567:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541943936 00000100:00100000:2.0:1787882640.211576:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541943936 00000100:00100000:2.0:1787882640.211633:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:2.0:1787882640.211643:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+47:10441:x1874730541943936:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882640.211666:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882640.211686:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430c4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882640.211947:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787882640.212161:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df243 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430c4 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.212175:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:2.0:1787882640.212178:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787882640.212182:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430c4 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.212193:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265c00, rc 0) 00000100:00100000:2.0:1787882640.212242:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+48:10441:x1874730541943936:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 601us (773us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787882640.212249:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:2.0:1787882640.221446:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882640.222510:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541944064 00000100:00100000:3.0:1787882640.222520:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541944064 00000100:00100000:3.0:1787882640.222571:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:3.0:1787882640.222581:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+48:10441:x1874730541944064:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:3.0:1787882640.222659:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df251 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.222677:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df251 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.222688:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df251 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.222702:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.222723:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.222730:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223236:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df25f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223247:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223255:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787882640.223298:0:6733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223311:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df251 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223317:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df251 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223324:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df251 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223330:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cfa00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882640.223334:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df251 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223341:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df251 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223361:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:3.0:1787882640.223364:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882640.223369:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df251 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223374:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df251 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223386:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223393:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df258 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223398:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223403:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882640.223406:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223412:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223418:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa2a0727b00) 00010000:00010000:3.0:1787882640.223421:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882640.223423:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df258 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223428:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223452:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df25f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223458:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df25f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223463:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df25f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223468:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882640.223471:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df25f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223477:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df25f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223484:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:3.0:1787882640.223486:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882640.223489:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df25f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.223495:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df25f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882640.223576:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+48:10441:x1874730541944064:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 995us (2138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882640.223583:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:1.0:1787882640.231040:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882640.233032:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541944320 00000100:00100000:3.0:1787882640.233055:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541944320 00000100:00100000:3.0:1787882640.233111:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:3.0:1787882640.233138:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+48:10441:x1874730541944320:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1787882640.233766:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+49:10441:x1874730541944320:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 627us (2731us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787882640.233776:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000001:00080000:2.0:1787882640.245695:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000004:00080000:2.0:1787882640.245721:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787882640.245751:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967343 is committed 00000020:00080000:2.0:1787882640.245765:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa282b4a900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787882640.245769:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2b98dcf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa282b4a480 00000020:00080000:2.0:1787882640.245772:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2b98dc500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa2af149800 00000001:00080000:2.0:1787882640.245788:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967344 is committed 00000020:00080000:2.0:1787882640.245819:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787882640.245963:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787882640.246530:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563991168:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787882640.246668:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882640.246993:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563991168 00000100:00100000:2.0:1787882640.247000:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563991168 00000100:00100000:2.0:1787882640.247144:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787882640.247153:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730563991168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787882640.247177:0:9930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787882640.247204:0:9930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a90ec8d, atime: 0x6a90ec8d, ctime: 0x6a90ec8d, blocks: 0x1 00010000:00010000:2.0:1787882640.247212:0:9930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df266 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.247226:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:2.0:1787882640.247230:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882640.247235:0:9930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df266 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.247250:0:9930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df266 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.247258:0:9930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df266 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.247265:0:9930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df266 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.247288:0:9930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1787882640.247498:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882640.247848:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1874730563991168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 694us (1178us total) trans 4294967301 rc 0/0 00000004:00080000:3.0:1787882640.247917:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2bf43d180/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787882640.247924:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563991168:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787882640.248004:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1787882640.248084:0:11678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882640.248091:0:11678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df266 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.248100:0:11678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882640.248109:0:11678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df266 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.248118:0:11678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df266 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.248135:0:11678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df266 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.248142:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df266 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.248159:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882640.248161:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882640.248162:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882640.291924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882640.292679:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541944576 00000100:00100000:3.0:1787882640.292691:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541944576 00000100:00100000:3.0:1787882640.292761:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:3.0:1787882640.292771:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:10444:x1874730541944576:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882640.292795:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882640.292818:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df26d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430cb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.292932:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df274 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.292946:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.292957:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.292972:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df27b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.292979:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293000:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293374:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293385:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293393:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882640.293403:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787882640.293489:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293498:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df274 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293505:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293511:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882640.293515:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293524:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df274 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293536:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:3.0:1787882640.293539:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882640.293550:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293557:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293570:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293576:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df27b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293582:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df27b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293587:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882640.293590:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df27b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293595:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df27b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293602:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa2a0727b00) 00010000:00010000:3.0:1787882640.293605:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882640.293608:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df27b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293614:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df27b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293657:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df26d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430cb expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293683:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430cb expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.293691:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:3.0:1787882640.293694:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882640.293696:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cfa00, rc 0) 00000100:00100000:3.0:1787882640.293776:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:10444:x1874730541944576:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1006us (2301us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787882640.293784:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:3.0:1787882640.298329:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882640.298383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882640.298466:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541944832 00000100:00100000:0.0:1787882640.298476:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541944832 00000100:00100000:0.0:1787882640.298537:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:0.0:1787882640.298548:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:10444:x1874730541944832:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:0.0:1787882640.298629:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.298645:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.298656:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.298681:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.298701:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df290 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.298708:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.298714:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882640.298719:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.298726:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.298738:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:0.0:1787882640.298740:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787882640.298745:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df290 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.298750:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882640.298820:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:10444:x1874730541944832:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 274us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882640.298839:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:2.0:1787882640.299041:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541944704 00000100:00100000:2.0:1787882640.299046:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541944704 00000100:00100000:2.0:1787882640.299088:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:2.0:1787882640.299096:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:2358:x1874730541944704:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882640.299105:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882640.299119:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df282 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430cb expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882640.299131:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:2.0:1787882640.299134:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882640.299154:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:2358:x1874730541944704:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 59us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882640.299160:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:2.0:1787882640.301188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882640.301260:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541945088 00000100:00100000:3.0:1787882640.301269:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541945088 00000100:00100000:3.0:1787882640.301366:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:3.0:1787882640.301376:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:10444:x1874730541945088:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1787882640.301609:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:10444:x1874730541945088:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 227us (422us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787882640.301617:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00010000:00010000:1.0:1787882640.490632:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882640.505544:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882640.505920:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541945344 00000100:00100000:3.0:1787882640.505933:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541945344 00000100:00100000:3.0:1787882640.506009:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:3.0:1787882640.506022:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:10462:x1874730541945344:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:3.0:1787882640.506055:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882640.506083:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df297 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430d2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.506331:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df29e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.506349:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df29e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.506364:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df29e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882640.506377:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787882640.507480:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df297 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430d2 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.508057:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df29e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430d2 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.508068:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:3.0:1787882640.508071:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787882640.508075:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67ce400, rc 0) 00000100:00100000:3.0:1787882640.508316:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10462:x1874730541945344:12345-192.168.206.21@tcp:101:cat.0 Request processed in 2293us (2783us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787882640.508327:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:2.0:1787882640.576049:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882640.576627:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541945472 00000100:00100000:0.0:1787882640.576642:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541945472 00000100:00100000:0.0:1787882640.576775:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:0.0:1787882640.576798:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10463:x1874730541945472:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1787882640.576837:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882640.576916:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df2ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430d9 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.577002:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df2b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.577017:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.577030:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882640.577284:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787882640.577289:0:6733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882640.577373:0:6733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.577410:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df2ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430d9 expref: 19 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.577429:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430d9 expref: 18 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882640.577439:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:0.0:1787882640.577442:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787882640.577446:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9200, rc 0) 00000100:00100000:0.0:1787882640.579360:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10463:x1874730541945472:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 2557us (3310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882640.579375:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:3.0:1787882640.586106:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882640.586523:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541945856 00000100:00100000:1.0:1787882640.586534:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541945856 00000100:00100000:1.0:1787882640.586603:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:1.0:1787882640.586614:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10463:x1874730541945856:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:1.0:1787882640.587048:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10463:x1874730541945856:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 434us (950us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787882640.587056:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:2.0:1787882640.592238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882640.592457:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541945984 00000100:00100000:3.0:1787882640.592466:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541945984 00000100:00100000:3.0:1787882640.592527:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:3.0:1787882640.592537:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10463:x1874730541945984:12345-192.168.206.21@tcp:103:lfs.0 00010000:00010000:3.0:1787882640.592568:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787882640.592594:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df23c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430bd expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.592626:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df29e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430d2 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.592637:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5df147 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84307e expref: 17 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.592647:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160700) 00010000:00010000:3.0:1787882640.592677:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882640.592743:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:10463:x1874730541945984:12345-192.168.206.21@tcp:103:lfs.0 Request processed in 206us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882640.592751:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:0.0:1787882640.595646:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882640.595954:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541946112 00000100:00100000:1.0:1787882640.595973:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541946112 00000100:00100000:1.0:1787882640.596053:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:1.0:1787882640.596066:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:10463:x1874730541946112:12345-192.168.206.21@tcp:58:lfs.0 00010000:00010000:1.0:1787882640.596225:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df2ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882640.596246:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df2ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882640.596261:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df2ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787882640.598338:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787882640.600843:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787882640.600979:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787882640.602320:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:10463:x1874730541946112:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 6244us (6675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882640.602335:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:1.0:1787882640.640769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882640.640995:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541946240 00000100:00100000:3.0:1787882640.641009:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541946240 00000100:00100000:3.0:1787882640.641094:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:3.0:1787882640.641106:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:10465:x1874730541946240:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882640.641134:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882640.641161:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430e0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.641259:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.641275:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.641307:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.641325:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.641332:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.641339:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.641957:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.641971:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.641980:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882640.642026:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787882640.642031:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882640.642054:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642067:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642077:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642095:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642102:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642109:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882640.642114:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642122:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642136:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:3.0:1787882640.642140:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882640.642145:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642151:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642166:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642171:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642177:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642182:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882640.642191:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642198:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642206:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa2a0727b00) 00010000:00010000:3.0:1787882640.642208:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882640.642211:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642216:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642254:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430e0 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642267:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430e0 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882640.642275:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa283291000) 00010000:00010000:3.0:1787882640.642277:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787882640.642280:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67ce000, rc 0) 00000100:00100000:3.0:1787882640.642374:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10465:x1874730541946240:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1269us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882640.642384:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:2.0:1787882640.683704:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563991424:0@lo:400:kworker.0 00000100:00100000:2.0:1787882640.683795:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882640.683897:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563991936:0@lo:400:kworker.0 00000100:00100000:2.0:1787882640.683929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882640.683958:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787882640.683964:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563991296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882640.683989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882640.684005:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563991808:0@lo:400:kworker.0 00000100:00100000:2.0:1787882640.684032:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882640.684087:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563991552:0@lo:400:kworker.0 00000100:00100000:2.0:1787882640.684112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882640.684132:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787882640.684137:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563991680:0@lo:400:kworker.0 00000100:00100000:2.0:1787882640.684158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882640.684188:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563991424 00000100:00100000:2.0:1787882640.684197:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563991424 00000100:00100000:0.0:1787882640.685361:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563991296 00000100:00100000:0.0:1787882640.685373:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563991296 00000100:00100000:0.0:1787882640.685423:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787882640.685435:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730563991296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882640.685494:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882640.685577:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730563991296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882640.685585:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787882640.685631:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563991936 00000100:00100000:0.0:1787882640.685636:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563991936 00000100:00100000:0.0:1787882640.685676:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787882640.685683:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563991936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882640.685732:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563991936:12345-0@lo:400:kworker.0 Request processed in 50us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882640.685739:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787882640.685805:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563991296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882640.685830:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563991936:0@lo:400:kworker.0 00000100:00100000:0.0:1787882640.685915:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563991808 00000100:00100000:0.0:1787882640.685919:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563991808 00000100:00100000:0.0:1787882640.685948:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563991552 00000100:00100000:0.0:1787882640.685952:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563991552 00000100:00100000:0.0:1787882640.685963:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563991680 00000100:00100000:0.0:1787882640.685966:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563991680 00000100:00100000:0.0:1787882640.685982:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787882640.686068:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563991808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882640.686113:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563991808:12345-0@lo:400:kworker.0 Request processed in 125us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882640.686137:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787882640.686152:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787882640.686158:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563991552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882640.686194:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730563991552:12345-0@lo:400:kworker.0 Request processed in 36us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882640.686200:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787882640.686217:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787882640.686223:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563991680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882640.686251:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730563991680:12345-0@lo:400:kworker.0 Request processed in 29us (2093us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882640.686257:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787882640.686587:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563991808:0@lo:400:kworker.0 00000100:00100000:0.0:1787882640.686660:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730563991680:0@lo:400:kworker.0 00000100:00100000:0.0:1787882640.686673:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730563991552:0@lo:400:kworker.0 00000100:00100000:2.0:1787882640.687256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787882640.687274:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563991424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882640.687345:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563991424:12345-0@lo:400:kworker.0 Request processed in 78us (3550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882640.687352:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787882640.687426:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563991424:0@lo:400:kworker.0 00000100:00080000:2.0:1787882640.689103:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787882640.689115:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787882641.194269:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563992064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787882641.194363:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882641.194497:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563992064 00000100:00100000:0.0:1787882641.194508:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563992064 00000100:00100000:0.0:1787882641.194566:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787882641.194577:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563992064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787882641.194633:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882641.194698:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563992064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882641.194707:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787882641.194753:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563992064:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787882641.386130:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882641.386144:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882641.386218:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787882641.386226:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787882641.386415:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730563992192:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787882641.386538:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a02c7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787882641.393400:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.393961:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541946368 00000100:00100000:3.0:1787882641.393975:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541946368 00000100:00100000:3.0:1787882641.394060:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:3.0:1787882641.394073:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10476:x1874730541946368:12345-192.168.206.21@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787882641.394190:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10476:x1874730541946368:12345-192.168.206.21@tcp:900:lhsmtool_posix.0 Request processed in 119us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882641.394198:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00080000:2.0:1787882641.394678:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882641.396862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882641.397060:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730563992192:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787882641.397449:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541946496 00000100:00100000:3.0:1787882641.397458:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541946496 00000100:00100000:3.0:1787882641.397523:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:3.0:1787882641.397534:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10476:x1874730541946496:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787882641.397572:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787882641.397949:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10476:x1874730541946496:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 414us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882641.397958:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:0.0:1787882641.414356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.414488:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541946624 00000100:00100000:3.0:1787882641.414500:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541946624 00000100:00100000:3.0:1787882641.414574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:3.0:1787882641.414587:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10476:x1874730541946624:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787882641.414691:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2dd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.414719:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.414736:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.414986:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415012:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415043:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415089:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415099:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415107:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882641.415153:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787882641.415158:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882641.415172:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415183:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415190:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2dd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415196:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415202:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882641.415206:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415213:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2dd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415458:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:3.0:1787882641.415462:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882641.415478:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415486:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df2dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415505:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415512:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2e4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415518:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415523:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882641.415526:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415616:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2e4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415626:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9fa2a0727b00) 00010000:00010000:3.0:1787882641.415630:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882641.415634:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2e4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415924:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df2e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.415959:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.416291:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.416298:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.416303:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882641.416307:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.416313:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.416323:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa283291000) 00010000:00010000:3.0:1787882641.416326:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882641.416329:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.416334:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df2eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882641.416577:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10476:x1874730541946624:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 Request processed in 1987us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882641.416589:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:1.0:1787882641.421796:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882641.421913:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541946880 00000100:00100000:0.0:1787882641.421932:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541946880 00000100:00100000:0.0:1787882641.422018:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:0.0:1787882641.422030:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10476:x1874730541946880:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882641.422059:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882641.422092:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df2f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430e7 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422235:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df2f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422266:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422280:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882641.422294:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787882641.422446:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422456:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df2f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422487:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422494:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882641.422500:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422508:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df2f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422524:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa283291000) 00010000:00010000:0.0:1787882641.422527:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787882641.422533:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df2f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422539:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df2f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422587:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df2f2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430e7 expref: 19 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422611:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:0.0:1787882641.422613:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787882641.422618:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df2f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430e7 expref: 19 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.422627:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9000, rc 0) 00000100:00100000:0.0:1787882641.422708:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10476:x1874730541946880:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 680us (920us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787882641.422736:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:1.0:1787882641.427331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882641.427402:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541947008 00000100:00100000:0.0:1787882641.427414:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541947008 00000100:00100000:0.0:1787882641.427499:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00100000:0.0:1787882641.427512:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10476:x1874730541947008:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787882641.427562:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787882641.427730:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10476:x1874730541947008:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 220us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882641.427739:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00100000:0.0:1787882641.443828:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.443928:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541947264 00000100:00100000:3.0:1787882641.443943:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541947264 00000100:00100000:3.0:1787882641.444023:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:3.0:1787882641.444049:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10476:x1874730541947264:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882641.444071:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882641.444075:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787882641.444101:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df2b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430d9 expref: 18 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.444121:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:3.0:1787882641.444126:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787882641.444139:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df307 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430ee expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787882641.444782:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787882641.445081:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df30e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.445094:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df30e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.445104:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df30e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.445169:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df307 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430ee expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.445186:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df30e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430ee expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.445195:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa2a0727b00) 00010000:00010000:3.0:1787882641.445198:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882641.445209:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cf000, rc 0) 00000100:00100000:3.0:1787882641.445272:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10476:x1874730541947264:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1225us (1466us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787882641.445281:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:3.0:1787882641.452336:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882641.452611:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541947520 00000100:00100000:2.0:1787882641.452620:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541947520 00000100:00100000:2.0:1787882641.452682:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:2.0:1787882641.452693:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10476:x1874730541947520:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787882641.452756:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882641.452783:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df30e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430ee expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.452827:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa2a0727b00) 00010000:00010000:2.0:1787882641.452839:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787882641.452863:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df31c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.452908:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df31c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.452918:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df31c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.452988:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df323 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x363fdc77 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.452998:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x363fdc77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453006:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x363fdc77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453319:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df31c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453327:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df31c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453335:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df31c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453341:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882641.453346:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df31c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453373:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df31c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453383:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:2.0:1787882641.453386:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882641.453389:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df31c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453395:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df31c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453406:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x363fdc77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453412:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df323 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x363fdc77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453418:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df323 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x363fdc77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453424:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882641.453426:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df323 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x363fdc77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453432:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df323 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x363fdc77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453438:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x363fdc77 (ffff9fa285a00a00) 00010000:00010000:2.0:1787882641.453441:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882641.453444:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df323 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x363fdc77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.453459:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df323 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x363fdc77 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882641.453558:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10476:x1874730541947520:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 865us (1230us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787882641.453567:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:3.0:1787882641.462862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882641.463421:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541947648 00000100:00100000:0.0:1787882641.463440:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541947648 00000100:00100000:0.0:1787882641.463534:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:0.0:1787882641.463547:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10476:x1874730541947648:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882641.463574:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882641.463603:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df32a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430f5 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.463648:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df331 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.463665:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.463679:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df331 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.463942:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df32a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430f5 expref: 20 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.463965:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430f5 expref: 19 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.463974:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:0.0:1787882641.463978:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787882641.463981:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9c00, rc 0) 00000100:00100000:0.0:1787882641.464070:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10476:x1874730541947648:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 525us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882641.464079:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:0.0:1787882641.466809:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882641.466898:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541947904 00000100:00100000:0.0:1787882641.466909:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541947904 00000100:00100000:0.0:1787882641.466976:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:0.0:1787882641.466988:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10476:x1874730541947904:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787882641.467103:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df338 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.467123:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df338 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.467135:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df338 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787882641.467527:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787882641.467559:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357616688219ns, next at 358616684912ns, rc = 0 00000004:00010000:0.0:1787882641.467687:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034e02ab6 reply state 000000006eeb3e98 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df338 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882641.467699:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787882641.467832:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:10476:x1874730541947904:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 845us (1036us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787882641.469715:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 75 00010000:00010000:3.0:1787882641.476623:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df338 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.476646:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df338 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.476656:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df338 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.476663:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882641.476669:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df338 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.476678:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df338 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.476700:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:3.0:1787882641.476704:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787882641.476710:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df338 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.476717:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df338 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882641.477560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.477698:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541948032 00000100:00100000:3.0:1787882641.477713:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541948032 00000100:00100000:3.0:1787882641.477807:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:3.0:1787882641.477831:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:10476:x1874730541948032:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882641.477928:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882641.477953:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df33f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8430fc expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.478026:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df33f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430fc expref: 21 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.478040:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df33f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430fc expref: 21 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.478060:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:3.0:1787882641.478063:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787882641.478067:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cee00, rc 0) 00000100:00100000:3.0:1787882641.478135:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:10476:x1874730541948032:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 318us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882641.478146:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:2.0:1787882641.492052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882641.492150:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541948160 00000100:00100000:1.0:1787882641.492168:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541948160 00000100:00100000:1.0:1787882641.492236:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:1.0:1787882641.492258:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874730541948160:12345-192.168.206.21@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787882641.492302:0:6711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp t0 exp 0000000000000000 cur 357 last 0 00000020:00000080:1.0:1787882641.492357:0:6711:0:(genops.c:1385:class_connect()) connect: client 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9, cookie 0xf4731e8a7c5df346 00002000:00100000:1.0:1787882641.492382:0:6711:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9/ffff9fa2bff28800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787882641.492397:0:6711:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787882641.492708:0:6711:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787882641.492990:0:6711:0:(import.c:65:import_set_state_nolock()) ffff9fa2bff2c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787882641.493447:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2355:x1874730541948160:12345-192.168.206.21@tcp:8:lhsmtool_posix.0 Request processed in 1195us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882641.493459:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00010000:00010000:1.0:1787882641.514080:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882641.524429:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882641.524638:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541948288 00000100:00100000:0.0:1787882641.524652:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541948288 00000100:00100000:0.0:1787882641.524754:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:0.0:1787882641.524768:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:0:x1874730541948288:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787882641.524839:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787882641.617502:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1787882641.617528:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000100:00100000:1.0:1787882641.620414:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:0:x1874730541948288:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 95633us (95984us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787882641.620431:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:1.0:1787882641.638586:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882641.643852:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541948544 00000100:00100000:2.0:1787882641.643965:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541948544 00000100:00100000:2.0:1787882641.644085:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:2.0:1787882641.644108:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:10476:x1874730541948544:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787882641.644451:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:10476:x1874730541948544:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 355us (5879us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787882641.644459:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:1.0:1787882641.648953:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882641.650027:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541948800 00000100:00100000:1.0:1787882641.650041:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541948800 00000100:00100000:1.0:1787882641.650123:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 77 00000100:00100000:1.0:1787882641.650134:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:10476:x1874730541948800:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787882641.650278:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:10476:x1874730541948800:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 146us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882641.650287:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 77 00000100:00100000:3.0:1787882641.652847:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.652913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541948928 00000100:00100000:3.0:1787882641.652924:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541948928 00000100:00100000:3.0:1787882641.652985:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:3.0:1787882641.652998:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:10476:x1874730541948928:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882641.653024:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882641.653050:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df34d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843103 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.653176:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df354 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.653193:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.653205:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882641.653250:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882641.653273:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.653305:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df34d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843103 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.653328:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843103 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.653338:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:3.0:1787882641.653341:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787882641.653345:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67ce400, rc 0) 00000100:00100000:3.0:1787882641.653415:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:10476:x1874730541948928:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 420us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882641.653423:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:2.0:1787882641.657321:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.657452:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541949056 00000100:00100000:3.0:1787882641.657465:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541949056 00000100:00100000:3.0:1787882641.657532:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:3.0:1787882641.657562:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2359:x1874730541949056:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882641.657586:0:9930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882641.657625:0:9930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df3e976b/0xf4731e8a7c5df35b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84310a expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787882641.657660:0:9930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90ec91, blocks: 0x1 00010000:00010000:3.0:1787882641.657685:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1787882641.657700:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882641.657718:0:9930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df3e976b/0xf4731e8a7c5df35b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84310a expref: 6 pid: 9930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.657743:0:9930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000df3e976b/0xf4731e8a7c5df35b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84310a expref: 6 pid: 9930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.657759:0:9930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cf000, rc 0) 00000100:00100000:3.0:1787882641.657841:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541949056:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 282us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882641.657849:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:3.0:1787882641.660561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882641.660699:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541949312 00000100:00100000:2.0:1787882641.660710:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541949312 00000100:00100000:2.0:1787882641.660771:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:2.0:1787882641.660781:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:10476:x1874730541949312:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787882641.660931:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:10476:x1874730541949312:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 152us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882641.660940:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:2.0:1787882641.670772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882641.671179:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541949440 00000100:00100000:0.0:1787882641.671192:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541949440 00000100:00100000:0.0:1787882641.671277:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:0.0:1787882641.671291:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:10476:x1874730541949440:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882641.671316:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882641.671343:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843111 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.671383:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df3e976b/0xf4731e8a7c5df35b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84310a expref: 7 pid: 9930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.671393:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882641.671398:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882641.671404:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.671465:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df3e976b/0xf4731e8a7c5df35b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84310a expref: 7 pid: 9930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.671482:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df3e976b/0xf4731e8a7c5df35b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84310a expref: 7 pid: 9930 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882641.671498:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6710:1874730563992320:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882641.671625:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a02c73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882641.673042:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6710:1874730563992320:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882641.673080:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.673103:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9400, rc 0) 00000100:00100000:0.0:1787882641.673161:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:10476:x1874730541949440:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1872us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882641.673172:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:3.0:1787882641.684446:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882641.684999:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541949568 00000100:00100000:1.0:1787882641.685013:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541949568 00010000:00010000:1.0:1787882641.685071:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df3e976b/0xf4731e8a7c5df35b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84310a expref: 7 pid: 9930 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882641.685156:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:1.0:1787882641.685168:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d852450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730541949568:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882641.685188:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882641.685218:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df3e976b/0xf4731e8a7c5df35b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84310a expref: 7 pid: 9930 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882641.685234:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df3e976b/0xf4731e8a7c5df35b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84310a expref: 7 pid: 9930 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882641.685264:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df3e976b/0xf4731e8a7c5df35b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84310a expref: 7 pid: 9930 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882641.685285:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882641.685290:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882641.685299:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882641.685310:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882641.685364:0:8466:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882641.685382:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8466:1874730563992448:192.168.206.21@tcp:105: 00000100:00100000:1.0:1787882641.685506:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7178240 going to sleep for 11 seconds 00000100:00100000:0.0:1787882641.694239:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8466:1874730563992448:192.168.206.21@tcp:105: 00010000:00010000:0.0:1787882641.694278:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882641.694358:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d852450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541949568:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 9191us (9926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882641.694371:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:1.0:1787882641.705909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.707833:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541949696 00000100:00100000:3.0:1787882641.707852:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541949696 00002000:00100000:3.0:1787882641.708022:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fa2bf43df80 x1874730541949696/t0(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:372/0 lens 504/0 e 0 to 0 dl 1787882652 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787882641.708033:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2bf43df80 with x1874730541949696 ext(0->8) 00002000:00010000:3.0:1787882641.708040:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2bf43df80 00000100:00100000:3.0:1787882641.708127:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:3.0:1787882641.708138:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541949696:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787882641.709070:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730541949696:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 Request processed in 925us (3200us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787882641.709083:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00002000:00100000:3.0:1787882641.709094:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fa2bf43df80 x1874730541949696/t4294967302(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:372/0 lens 504/448 e 0 to 0 dl 1787882652 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787882641.709103:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2bf43df80 with x1874730541949696 ext(0->8) 00002000:00010000:3.0:1787882641.709109:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2bf43df80 00000100:00100000:1.0:1787882641.717343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.717448:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541949824 00000100:00100000:3.0:1787882641.717465:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541949824 00000100:00100000:3.0:1787882641.717547:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:3.0:1787882641.717559:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:10476:x1874730541949824:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787882641.820835:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1787882641.820853:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787882641.820896:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:2.0:1787882641.820902:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1787882641.820935:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787882641.820946:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787882641.823111:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787882641.823138:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563992576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787882641.823222:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:10476:x1874730541949824:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 Request processed in 105660us (105891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882641.823225:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882641.823236:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:3.0:1787882641.823280:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563992576 00000100:00100000:3.0:1787882641.823290:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563992576 00000100:00100000:3.0:1787882641.823342:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787882641.823353:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730563992576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787882641.823548:0:9930:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787882641.823553:0:9930:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787882641 00002000:00010000:3.0:1787882641.823555:0:9930:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787882641.823557:0:9930:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787882641 -> 1787882641 00002000:00010000:3.0:1787882641.823559:0:9930:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787882641.823620:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730563992576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 269us (395us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787882641.823628:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1787882641.823706:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2bf3fea00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787882641.823713:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563992576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787882641.835639:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.835719:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541949952 00000100:00100000:3.0:1787882641.835732:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541949952 00000100:00100000:3.0:1787882641.835797:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:3.0:1787882641.835810:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2357:x1874730541949952:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 00000040:00080000:1.0:1787882641.840640:0:12014:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787882641.840652:0:12014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787882641.840710:0:12014:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787882641.840725:0:12014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787882641.906679:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1787882641.906701:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1787882641.906765:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541949952:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 Request processed in 70952us (71133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882641.906777:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:2.0:1787882641.912109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882641.912378:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541950208 00000100:00100000:2.0:1787882641.912387:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541950208 00000100:00100000:2.0:1787882641.912440:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:2.0:1787882641.912451:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:10476:x1874730541950208:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787882641.912503:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882641.912534:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df354 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843103 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.912551:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:2.0:1787882641.912555:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787882641.913119:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df369 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.913135:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.913156:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787882641.913412:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042a69e42 reply state 00000000e923072e transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882641.913422:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787882641.913523:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:10476:x1874730541950208:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 1071us (1420us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787882641.913532:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:1.0:1787882641.923054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:3.0:1787882641.925103:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.925119:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df369 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.925127:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.925134:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882641.925139:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.925147:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df369 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.925164:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:3.0:1787882641.925168:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882641.925172:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df369 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.925199:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df369 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882641.925478:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541950336 00000100:00100000:2.0:1787882641.925488:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541950336 00000100:00100000:2.0:1787882641.925596:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:2.0:1787882641.925607:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541950336:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787882641.925854:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787882641.925858:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787882641 -> 1787882639 00002000:00010000:2.0:1787882641.925860:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787882637 00002000:00010000:2.0:1787882641.925862:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787882641 -> 1787882639 00002000:00010000:2.0:1787882641.925865:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787882641.925956:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541950336:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 351us (2909us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787882641.925963:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:3.0:1787882641.930385:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882641.930523:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541950592 00000100:00100000:0.0:1787882641.930532:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541950592 00000100:00100000:0.0:1787882641.930604:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:0.0:1787882641.930614:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:10476:x1874730541950592:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787882641.930676:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.930692:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df331 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430f5 expref: 13 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.930700:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.930732:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430f5 expref: 13 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.930747:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df331 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430f5 expref: 13 pid: 6733 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882641.930761:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730563992704:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882641.930850:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2929a3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787882641.942802:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.942895:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541950720 00000100:00100000:3.0:1787882641.942905:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541950720 00010000:00010000:3.0:1787882641.942946:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df331 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430f5 expref: 14 pid: 6733 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882641.942970:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730563992704:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882641.942979:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:3.0:1787882641.942988:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:2357:x1874730541950720:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882641.942996:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.943001:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882641.943008:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df331 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430f5 expref: 14 pid: 6733 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.943033:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df331 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430f5 expref: 14 pid: 6733 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.947840:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df331 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430f5 expref: 14 pid: 6733 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.947863:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:3.0:1787882641.947932:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.947943:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.947963:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.948157:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882641.948286:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2357:x1874730541950720:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 5297us (5494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882641.948296:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00010000:00010000:2.0:1787882641.948357:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.948366:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.948394:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.948401:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.948407:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.948414:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882641.948419:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.948426:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.948436:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:2.0:1787882641.948439:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787882641.948443:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.948448:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df370 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882641.948489:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+12:10476:x1874730541950592:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 Request processed in 17876us (18112us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787882641.948507:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:1.0:1787882641.952512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.952674:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541950848 00000100:00100000:3.0:1787882641.952761:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541950848 00000100:00100000:3.0:1787882641.952832:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:3.0:1787882641.952842:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2358:x1874730541950848:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787882641.953004:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.953195:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.953205:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787882641.953210:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787882641.953215:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.953249:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.953264:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 7 pid: 6710 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882641.953286:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6710:1874730563992832:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882641.953404:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28601acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882641.956794:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6710:1874730563992832:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882641.956794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:3.0:1787882641.956842:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882641.956951:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541950976 00000100:00100000:2.0:1787882641.956959:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541950976 00010000:00010000:2.0:1787882641.956995:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 8 pid: 6710 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882641.957033:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:2.0:1787882641.957043:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730541950976:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882641.957063:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882641.957088:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 8 pid: 6710 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.957100:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 8 pid: 6710 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.957128:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e90ff58/0xf4731e8a7c5df362 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843111 expref: 8 pid: 6710 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.957144:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882641.957149:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882641.957154:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.957162:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.957194:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882641.957241:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730541950976:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 199us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882641.957249:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00010000:00010000:3.0:1787882641.957322:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.957330:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.957355:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.957363:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.957371:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.957377:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf400 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882641.957381:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.957400:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.957412:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.957420:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a5bc5d6/0xf4731e8a7c5df377 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882641.957461:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541950848:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 Request processed in 4621us (4957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882641.957469:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:1.0:1787882641.969737:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.970711:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541951232 00000100:00100000:3.0:1787882641.970721:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541951232 00000100:00100000:3.0:1787882641.970781:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 83 00000100:00100000:3.0:1787882641.970793:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+12:10476:x1874730541951232:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787882641.972449:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df37e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.972471:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df37e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.972483:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df37e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.972701:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.972721:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df33f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430fc expref: 13 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.972729:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.972766:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df33f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430fc expref: 13 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.972783:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df33f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430fc expref: 13 pid: 6733 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882641.972797:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563992960:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882641.973123:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28601acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882641.977169:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882641.977201:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541951360 00000100:00100000:2.0:1787882641.977208:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541951360 00010000:00010000:2.0:1787882641.977245:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df33f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430fc expref: 14 pid: 6733 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882641.977278:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:2.0:1787882641.977287:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:2356:x1874730541951360:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882641.977302:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882641.977309:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df33f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430fc expref: 14 pid: 6733 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.977322:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df33f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430fc expref: 14 pid: 6733 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.977342:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:2.0:1787882641.977347:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.977356:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.977363:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.977391:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882641.977438:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:2356:x1874730541951360:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 152us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882641.977446:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00010000:00010000:0.0:1787882641.977609:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df33f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430fc expref: 13 pid: 6733 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882641.977627:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563992960:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882641.977651:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.977660:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.977676:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787882641.977902:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787882641.978049:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787882641.978096:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787882641.978202:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1874730563993088:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787882641.978256:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882641.978281:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28c06d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787882641.978694:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563993088 00000100:00100000:2.0:1787882641.978703:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563993088 00000100:00100000:2.0:1787882641.978745:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787882641.978754:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874730563993088:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787882641.978847:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874730563993088:12345-0@lo:1000:mdt00_002.0 Request processed in 94us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882641.978855:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787882641.979124:0:5845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787882641.979129:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2bf3fea00, transno 4294967303 00000100:00100000:0.0:1787882641.979147:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1874730563993088:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787882641.979583:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787882641.979658:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1874730563993216:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787882641.981275:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882641.981415:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2980436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882641.981456:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563993216 00000100:00100000:2.0:1787882641.981464:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563993216 00000100:00100000:2.0:1787882641.981611:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787882641.981624:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1874730563993216:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787882641.981993:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1874730563993216:12345-0@lo:1000:mdt00_002.0 Request processed in 371us (721us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787882641.982001:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787882641.982234:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1874730563993216:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787882641.982276:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982286:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982293:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982299:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cfa00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882641.982303:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982320:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982336:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:0.0:1787882641.982338:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787882641.982343:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982349:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df385 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982388:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df2ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982394:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df2ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982400:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df2ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982404:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882641.982407:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df2ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982412:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df2ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982419:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa283291000) 00010000:00010000:0.0:1787882641.982422:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787882641.982425:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df2ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982440:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df2ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982464:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982479:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430e0 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982489:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982522:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430e0 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.982537:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430e0 expref: 16 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882641.982550:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563993344:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882641.982727:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2980436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882641.988014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882641.988316:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563993344:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882641.988340:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882641.988421:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541951488 00000100:00100000:1.0:1787882641.988440:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541951488 00010000:00010000:1.0:1787882641.988482:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430e0 expref: 17 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882641.988519:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:1.0:1787882641.988528:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:2357:x1874730541951488:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882641.988541:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882641.988547:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430e0 expref: 17 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882641.988568:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430e0 expref: 17 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882641.988599:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df2d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8430e0 expref: 17 pid: 5845 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882641.988616:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa283291000) 00010000:00010000:1.0:1787882641.988621:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882641.988632:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882641.988640:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882641.988669:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787882641.988698:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988706:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988717:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988734:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882641.988735:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:2357:x1874730541951488:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 207us (734us total) trans 0 rc 0/0 00010000:00010000:2.0:1787882641.988741:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882641.988743:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00010000:00010000:2.0:1787882641.988747:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882641.988751:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988758:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988767:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa283291000) 00010000:00010000:2.0:1787882641.988770:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882641.988773:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988779:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df38c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988790:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df37e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988794:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df37e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988799:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df37e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988803:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882641.988813:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df37e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988829:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df37e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988837:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa283291000) 00010000:00010000:2.0:1787882641.988839:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787882641.988842:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df37e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882641.988848:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df37e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787882641.989162:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787882641.989167:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787882641.989192:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787882641.989197:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787882641.989262:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:10476:x1874730541951232:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 18470us (19585us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787882641.989270:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 83 00000020:00080000:2.0:1787882641.989274:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787882641.996554:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882641.996645:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541951744 00000100:00100000:3.0:1787882641.996654:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541951744 00000100:00100000:0.0:1787882641.997077:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:0.0:1787882641.997089:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:10476:x1874730541951744:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787882641.997834:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787882641.997973:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1787882641.998027:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df393 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.998047:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.998061:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.998069:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df393 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.998076:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df393 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.998082:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df393 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882641.998105:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787882641.998195:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10476:x1874730541951744:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 1107us (1646us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787882641.998205:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000020:00080000:0.0:1787882641.998211:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787882641.998283:0:11677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882641.998291:0:11677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df393 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.998298:0:11677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9400 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882641.998302:0:11677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df393 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.998310:0:11677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df393 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.998322:0:11677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:3.0:1787882641.998325:0:11677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787882641.998338:0:11677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df393 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.998345:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df393 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882641.998370:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882641.998372:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882641.998374:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882642.084363:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882642.084402:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882642.084479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882642.084710:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541952000 00000100:00100000:2.0:1787882642.084718:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541952000 00000100:00100000:2.0:1787882642.084782:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:2.0:1787882642.084792:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541952000:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882642.084909:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541952000:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 78us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882642.084918:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:1.0:1787882642.085864:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541951872 00000100:00100000:1.0:1787882642.085906:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541951872 00000100:00100000:1.0:1787882642.085949:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 287 00000100:00100000:1.0:1787882642.085956:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541951872:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882642.086005:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730541951872:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 50us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882642.086011:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 287 00000100:00080000:0.0:1787882642.086100:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787882642.087745:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541952128 00000100:00100000:3.0:1787882642.087756:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541952128 00000100:00100000:3.0:1787882642.087838:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 135 00000100:00100000:3.0:1787882642.087849:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541952128:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:0.0:1787882642.087963:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882642.088054:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2357:x1874730541952128:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 207us (3650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882642.088062:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 135 00010000:00010000:0.0:1787882642.540079:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787882643.051058:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787882643.051073:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787882643.051108:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787882643.051114:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787882643.570797:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787882643.646303:0:12065:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882643.646314:0:12065:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882643.646383:0:12065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787882643.646389:0:12065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787882643.767283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882643.767454:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541952384 00000100:00100000:3.0:1787882643.767463:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541952384 00000100:00100000:3.0:1787882643.767580:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:3.0:1787882643.767590:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:10495:x1874730541952384:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882643.767615:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882643.767639:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df39a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843118 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.767929:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df3a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.767943:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.767967:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882643.767979:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787882643.768249:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df39a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843118 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.768267:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df3a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843118 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.768277:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:3.0:1787882643.768280:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787882643.768284:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cf400, rc 0) 00000100:00100000:3.0:1787882643.768421:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10495:x1874730541952384:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 831us (1145us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787882643.768429:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00080000:0.0:1787882643.771257:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882643.780304:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882643.781953:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541952512 00000100:00100000:2.0:1787882643.781964:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541952512 00000100:00100000:2.0:1787882643.782027:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:2.0:1787882643.782038:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10495:x1874730541952512:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:2.0:1787882643.782104:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782119:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782130:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782143:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782222:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782230:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782561:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782569:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782654:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787882643.782699:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782711:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782717:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782723:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782729:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882643.782733:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782741:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782753:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:2.0:1787882643.782757:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882643.782761:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782768:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782779:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782790:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782796:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782802:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882643.782813:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782820:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782828:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa285a00a00) 00010000:00010000:2.0:1787882643.782830:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882643.782833:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782840:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782859:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782865:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782898:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782904:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882643.782913:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782919:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782928:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00100) 00010000:00010000:2.0:1787882643.782930:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882643.782933:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.782939:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882643.783035:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10495:x1874730541952512:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 997us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882643.783044:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 85 00000001:00080000:3.0:1787882643.834825:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1787882643.838134:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1787882643.841682:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882643.842121:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541952768 00000100:00100000:2.0:1787882643.842132:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541952768 00000100:00100000:2.0:1787882643.842262:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:2.0:1787882643.842274:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10498:x1874730541952768:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882643.842295:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882643.842315:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84311f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.842388:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.842402:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.842430:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.842449:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.842457:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.842464:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.843440:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df3d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.843453:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.843462:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882643.843474:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787882643.844158:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844246:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844253:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844259:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882643.844273:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844281:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844295:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:2.0:1787882643.844298:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882643.844303:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844309:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df3cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844323:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844330:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844336:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844342:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882643.844345:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844351:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844358:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa285a00100) 00010000:00010000:2.0:1787882643.844361:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882643.844371:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844376:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844436:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84311f expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844453:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84311f expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.844460:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:2.0:1787882643.844463:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787882643.844467:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264600, rc 0) 00000100:00100000:2.0:1787882643.845106:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:10498:x1874730541952768:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 2830us (3427us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787882643.845116:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:2.0:1787882643.855403:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882643.855462:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541952896 00000100:00100000:0.0:1787882643.855472:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541952896 00000100:00100000:0.0:1787882643.855530:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 87 00000100:00100000:0.0:1787882643.855541:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:10498:x1874730541952896:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:0.0:1787882643.855602:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df3e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.855618:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.855631:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.855656:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.855664:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df3e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.855669:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df3e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.855675:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882643.855680:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df3e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.855704:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df3e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.855716:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:0.0:1787882643.855719:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787882643.855724:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df3e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.855730:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df3e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882643.855813:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:10498:x1874730541952896:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 264us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882643.855822:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 87 00000100:00100000:1.0:1787882643.861271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882643.861374:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541953152 00000100:00100000:2.0:1787882643.861384:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541953152 00000100:00100000:2.0:1787882643.861439:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:2.0:1787882643.861451:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa288321c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:10498:x1874730541953152:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1787882643.861710:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa288321c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:10498:x1874730541953152:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 260us (448us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787882643.861718:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:3.0:1787882643.898617:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882643.898726:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541953408 00000100:00100000:2.0:1787882643.898737:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541953408 00000100:00100000:2.0:1787882643.898820:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:2.0:1787882643.898831:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:10019:x1874730541953408:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1787882643.898855:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882643.898905:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843126 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.899002:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.899017:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df3d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84311f expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.899026:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.899061:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84311f expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.899075:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df3d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84311f expref: 23 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882643.899088:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563993472:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882643.899194:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa282b4a900 going to sleep for 11 seconds 00000100:00100000:2.0:1787882643.902409:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563993472:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882643.902409:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:2.0:1787882643.902434:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882643.902799:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541953536 00000100:00100000:3.0:1787882643.902818:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541953536 00010000:00010000:3.0:1787882643.902859:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df3d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84311f expref: 24 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882643.902928:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:3.0:1787882643.902938:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:2357:x1874730541953536:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882643.902968:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882643.902976:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df3d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84311f expref: 24 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.902988:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84311f expref: 24 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.903011:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df3d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84311f expref: 24 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.903027:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:3.0:1787882643.903032:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.903042:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.903049:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.903078:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882643.903132:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:2357:x1874730541953536:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 195us (730us total) trans 0 rc 0/0 00010000:00010000:0.0:1787882643.903134:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.903141:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882643.903154:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 47 00000004:00200000:0.0:1787882643.903166:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787882643.903313:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df3ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843126 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.903329:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843126 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.903337:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:0.0:1787882643.903361:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787882643.903364:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265c00, rc 0) 00000100:00100000:0.0:1787882643.903392:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:10019:x1874730541953408:12345-192.168.206.21@tcp:101:bash.0 Request processed in 4563us (4786us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787882643.903399:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:1.0:1787882643.906721:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882643.906821:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541953792 00000100:00100000:2.0:1787882643.906837:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541953792 00000100:00100000:2.0:1787882643.906916:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 89 00000100:00100000:2.0:1787882643.906928:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:10019:x1874730541953792:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:2.0:1787882643.907206:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df403 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.907223:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882643.907233:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882643.907279:0:6733:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787882643.907302:0:6733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5e35e1f reply state 00000000e4954181 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882643.907310:0:6733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787882643.907348:0:6733:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787882643.907448:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:10019:x1874730541953792:12345-192.168.206.21@tcp:36:bash.0 Request processed in 520us (734us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787882643.907456:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 89 00000020:00080000:2.0:1787882643.907460:0:6733:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787882643.909448:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.909464:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df403 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.909497:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.909503:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882643.909507:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.909515:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df403 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.909531:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:3.0:1787882643.909534:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882643.909538:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df403 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.909544:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df403 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882643.911151:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882643.911302:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541953920 00000100:00100000:3.0:1787882643.911313:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541953920 00000100:00100000:3.0:1787882643.911370:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 90 00000100:00100000:3.0:1787882643.911380:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:10019:x1874730541953920:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1787882643.911403:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882643.911425:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df40a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84312d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.911500:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df40a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84312d expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.911531:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df40a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84312d expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882643.911552:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:3.0:1787882643.911556:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787882643.911559:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67ce000, rc 0) 00000100:00100000:3.0:1787882643.911617:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:10019:x1874730541953920:12345-192.168.206.21@tcp:101:bash.0 Request processed in 238us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882643.911624:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 90 00000100:00100000:1.0:1787882643.914734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882643.914859:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541954048 00000100:00100000:0.0:1787882643.914898:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541954048 00000100:00100000:0.0:1787882643.914967:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:0.0:1787882643.914978:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:10019:x1874730541954048:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1787882643.914996:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882643.915023:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5df411 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843134 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787882643.915057:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1787882643.915072:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a90ec8f, atime: 0x6a90ec8d, ctime: 0x6a90ec8f, blocks: 0xb 00010000:00010000:0.0:1787882643.915096:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1787882643.915102:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882643.915111:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5df411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843134 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.915129:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5df411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843134 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882643.915143:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8200, rc 0) 00000100:00100000:0.0:1787882643.915204:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:10019:x1874730541954048:12345-192.168.206.21@tcp:101:bash.0 Request processed in 228us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882643.915211:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:0.0:1787882643.919497:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882643.919646:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541954176 00000100:00100000:3.0:1787882643.919656:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541954176 00002000:00010000:3.0:1787882643.919706:0:6714:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787882643.919711:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2b727f100 with x1874730541954176 ext(0->18446744073709551615) 00002000:00010000:3.0:1787882643.919722:0:6714:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2b727f100. 00000100:00100000:3.0:1787882643.919814:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:3.0:1787882643.919824:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2359:x1874730541954176:12345-192.168.206.21@tcp:10:bash.0 00002000:00010000:3.0:1787882643.920860:0:6714:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787882643.920865:0:6714:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787882639 -> 1787882643 00002000:00010000:3.0:1787882643.920892:0:6714:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787882637 -> 1787882637 00002000:00010000:3.0:1787882643.920895:0:6714:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787882639 -> 1787882643 00002000:00010000:3.0:1787882643.920897:0:6714:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787882643.920968:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2359:x1874730541954176:12345-192.168.206.21@tcp:10:bash.0 Request processed in 1142us (1476us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787882643.920977:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00002000:00010000:3.0:1787882643.920982:0:6714:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787882643.920999:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2b727f100 with x1874730541954176 ext(0->18446744073709551615) 00002000:00010000:3.0:1787882643.921005:0:6714:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2b727f100. 00000100:00100000:1.0:1787882644.045693:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.045792:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541954304 00000100:00100000:0.0:1787882644.045801:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541954304 00000100:00100000:0.0:1787882644.045896:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 91 00000100:00100000:0.0:1787882644.045907:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:10512:x1874730541954304:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:0.0:1787882644.045976:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df418 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.045993:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df418 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.046004:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df418 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.046026:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df41f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.046033:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df41f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.046040:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df41f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047429:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df426 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047444:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047454:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787882644.047584:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047596:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df418 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047602:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df418 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047608:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df418 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047614:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.047618:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df418 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047625:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df418 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047638:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:0.0:1787882644.047641:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882644.047646:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df418 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047652:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df418 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047665:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df41f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047671:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df41f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047683:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df41f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047687:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.047690:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df41f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047695:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df41f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047703:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa289160b00) 00010000:00010000:0.0:1787882644.047706:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882644.047709:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df41f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047714:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df41f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047739:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047794:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df426 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047802:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047816:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.047819:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047836:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df426 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047845:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:0.0:1787882644.047847:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882644.047850:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df426 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.047855:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df426 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882644.048036:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:10512:x1874730541954304:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 2127us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882644.048045:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 91 00000100:00100000:1.0:1787882644.129718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.129772:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541954560 00000100:00100000:0.0:1787882644.129782:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541954560 00000100:00100000:0.0:1787882644.129850:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 92 00000100:00100000:0.0:1787882644.129862:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:10515:x1874730541954560:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1787882644.129904:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882644.129925:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df42d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84313b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.129993:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df434 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130007:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130017:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130047:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df43b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130055:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df43b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130061:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df43b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130365:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df442 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130375:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130382:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882644.130392:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787882644.130672:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130681:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df434 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130688:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130695:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.130699:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130719:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df434 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130730:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:0.0:1787882644.130733:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882644.130738:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df434 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130744:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df434 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130758:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df43b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130764:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df43b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130775:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df43b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130780:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.130785:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df43b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130791:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df43b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130797:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa289160b00) 00010000:00010000:0.0:1787882644.130799:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882644.130801:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df43b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130824:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df43b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130919:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df42d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84313b expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130933:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84313b expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.130940:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:0.0:1787882644.130943:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787882644.130945:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9200, rc 0) 00000100:00100000:0.0:1787882644.131002:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:10515:x1874730541954560:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1143us (1294us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787882644.131009:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 92 00000100:00100000:1.0:1787882644.135421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882644.135726:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541954688 00000100:00100000:2.0:1787882644.135737:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541954688 00000100:00100000:2.0:1787882644.135810:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 93 00000100:00100000:2.0:1787882644.135822:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:10515:x1874730541954688:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:2.0:1787882644.135916:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.135933:0:6733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843126 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.135955:0:6733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.135988:0:6733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843126 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.136001:0:6733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843126 expref: 29 pid: 5845 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882644.136015:0:6733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730563993600:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882644.136465:0:6733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2839413c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882644.139925:0:6733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730563993600:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882644.139956:0:6733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882644.140084:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.140155:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541954944 00000100:00100000:0.0:1787882644.140163:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541954944 00000100:00100000:0.0:1787882644.140216:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:0.0:1787882644.140225:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:5609:x1874730541954944:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787882644.140560:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:5609:x1874730541954944:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 334us (475us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787882644.140568:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:1.0:1787882644.143917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.144037:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541955072 00000100:00100000:0.0:1787882644.144047:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541955072 00010000:00010000:0.0:1787882644.144087:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843126 expref: 31 pid: 5845 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882644.144296:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:0.0:1787882644.144307:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:2357:x1874730541955072:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882644.144322:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882644.144330:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843126 expref: 31 pid: 5845 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.144416:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843126 expref: 31 pid: 5845 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.144441:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df3f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843126 expref: 31 pid: 5845 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.144457:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:0.0:1787882644.144463:0:8466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.144473:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.144480:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.144565:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882644.144636:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:2357:x1874730541955072:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 330us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882644.144644:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 48 00010000:00010000:2.0:1787882644.146482:0:6733:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.146497:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.146530:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.146537:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.146544:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.146566:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882644.146571:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.146589:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.146604:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:2.0:1787882644.146608:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787882644.146612:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.146619:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df450 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882644.146824:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:10515:x1874730541954688:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 11001us (11410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882644.146834:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 93 00000100:00100000:1.0:1787882644.150582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.150653:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541955328 00000100:00100000:0.0:1787882644.150684:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541955328 00000100:00100000:0.0:1787882644.150740:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:0.0:1787882644.150750:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:10515:x1874730541955328:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1787882644.151010:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:10515:x1874730541955328:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 260us (444us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787882644.151026:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:1.0:1787882644.307156:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.307332:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541955584 00000100:00100000:0.0:1787882644.307342:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541955584 00000100:00100000:0.0:1787882644.307410:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 94 00000100:00100000:0.0:1787882644.307421:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:10526:x1874730541955584:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:0.0:1787882644.307443:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882644.307463:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df457 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843142 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.307541:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df45e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.307554:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df45e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.307565:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df45e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.307588:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.307596:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.307603:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.307992:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df46c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.308001:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df46c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.308009:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df46c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882644.308018:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1787882644.308110:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df45e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.308118:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df45e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.308124:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df45e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.308128:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.308133:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df45e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.308139:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df45e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.308150:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:0.0:1787882644.308152:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882644.308156:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df45e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.309093:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df45e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.309111:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.309118:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df465 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.309125:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.309129:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.309133:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.309256:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df465 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.309269:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa289160b00) 00010000:00010000:0.0:1787882644.309272:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882644.309275:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df465 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.309281:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.309424:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df457 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843142 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.309442:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df46c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843142 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.309456:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:0.0:1787882644.309459:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882644.309462:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8400, rc 0) 00000100:00100000:0.0:1787882644.309792:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:10526:x1874730541955584:12345-192.168.206.21@tcp:101:cat.0 Request processed in 2370us (2643us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787882644.309811:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 94 00000100:00100000:1.0:1787882644.318182:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.318318:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541955840 00000100:00100000:0.0:1787882644.318329:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541955840 00000100:00100000:0.0:1787882644.318397:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:0.0:1787882644.318408:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:10526:x1874730541955840:12345-192.168.206.21@tcp:35:cat.0 00000100:00100000:0.0:1787882644.318674:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:10526:x1874730541955840:12345-192.168.206.21@tcp:35:cat.0 Request processed in 260us (493us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787882644.318683:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:1.0:1787882644.359646:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.360040:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541956096 00000100:00100000:0.0:1787882644.360051:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541956096 00000100:00100000:0.0:1787882644.360112:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00100000:0.0:1787882644.360123:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:10527:x1874730541956096:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1787882644.360203:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787882644.360230:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df46c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843142 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.360250:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df442 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84313b expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.360262:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df40a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84312d expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.360288:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:0.0:1787882644.360304:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787882644.360324:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df47a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.360336:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df47a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.360683:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df47a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.360702:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df481 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.360710:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.360717:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.361077:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df488 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.361086:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.361093:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787882644.365318:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787882644.365333:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360514462798ns, next at 361514459041ns, rc = 0 00010000:00010000:0.0:1787882644.365446:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df48f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365461:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df48f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365482:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df48f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365490:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df48f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365497:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df48f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365503:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df48f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365518:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882644.365539:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365546:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df488 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365552:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df488 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365558:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.365562:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df488 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365570:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df488 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365598:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:0.0:1787882644.365601:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787882644.365605:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df488 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365612:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5df488 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365631:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df47a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365638:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df47a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365644:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df47a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365648:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.365651:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df47a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365657:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df47a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365664:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:0.0:1787882644.365666:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882644.365678:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df47a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.365685:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5df47a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787882644.365704:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2e67648 reply state 00000000ee152ed6 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882644.365712:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787882644.365838:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:10527:x1874730541956096:12345-192.168.206.21@tcp:36:rm.0 Request processed in 5713us (6198us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787882644.365848:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 95 00010000:00010000:3.0:1787882644.368192:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.368208:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df481 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.368215:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.368220:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882644.368224:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.368232:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df481 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.368247:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa289160b00) 00010000:00010000:3.0:1787882644.368249:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882644.368254:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df481 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.368260:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df481 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.368456:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882644.368463:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df48f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.368481:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882644.368485:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df48f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.368492:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df48f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.368502:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:1.0:1787882644.368504:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787882644.368507:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df48f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.368513:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5df48f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.368529:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882644.368545:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882644.368547:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882644.418009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882644.418292:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541956352 00000100:00100000:3.0:1787882644.418303:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541956352 00000100:00100000:3.0:1787882644.418403:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:3.0:1787882644.418414:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:10533:x1874730541956352:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1787882644.418439:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882644.418484:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df496 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843149 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.418622:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df49d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.418637:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df49d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.418648:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df49d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.418662:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df4a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.418668:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df4a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.418674:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df4a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787882644.419271:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787882644.419445:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df4ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.419458:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df4ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.419466:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df4ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.419503:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df49d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.419522:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df49d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.419528:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df49d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.419534:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cee00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882644.419539:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df49d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.419546:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df49d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.419559:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:3.0:1787882644.419562:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882644.419568:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df49d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.419573:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df49d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787882644.419587:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff3da969 reply state 000000004204fa76 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df4a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882644.419596:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787882644.419628:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df496 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843149 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.419644:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df4ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843149 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.419664:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa2a0727400) 00010000:00010000:3.0:1787882644.419666:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882644.419669:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cf000, rc 0) 00000100:00100000:3.0:1787882644.419771:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:10533:x1874730541956352:12345-192.168.206.21@tcp:101:bash.0 Request processed in 1358us (1771us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787882644.419779:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 96 00010000:00010000:3.0:1787882644.422164:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df4a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.422181:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df4a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.422188:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df4a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.422194:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882644.422198:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df4a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.422205:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df4a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.422220:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa2a0727300) 00010000:00010000:3.0:1787882644.422223:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882644.422228:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df4a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.422235:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df4a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882644.424780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882644.424994:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541956480 00000100:00100000:2.0:1787882644.425004:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541956480 00000100:00080000:0.0:1787882644.425076:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882644.425079:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:2.0:1787882644.425089:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2356:x1874730541956480:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1787882644.425107:0:9930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882644.425126:0:9930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df4b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843150 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882644.425389:0:9930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787882644.425412:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1787882644.425429:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882644.425440:0:9930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df4b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843150 expref: 6 pid: 9930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.425460:0:9930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df4b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843150 expref: 6 pid: 9930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.425474:0:9930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264800, rc 0) 00000100:00100000:2.0:1787882644.425538:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541956480:12345-192.168.206.21@tcp:101:bash.0 Request processed in 449us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882644.425645:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:0.0:1787882644.428724:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882644.428800:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541956608 00000100:00100000:3.0:1787882644.428817:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541956608 00000100:00100000:3.0:1787882644.428893:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:3.0:1787882644.428903:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:10533:x1874730541956608:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1787882644.428920:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882644.428936:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843157 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.428965:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df4b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843150 expref: 7 pid: 9930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.428974:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882644.428978:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882644.428983:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.429014:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df4b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843150 expref: 7 pid: 9930 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.429026:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df4b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843150 expref: 7 pid: 9930 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882644.429039:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6710:1874730563993728:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882644.429121:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28601ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787882644.432688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882644.432838:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6710:1874730563993728:192.168.206.21@tcp:104: 00010000:00010000:3.0:1787882644.432908:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 7 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.432929:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cfa00, rc 0) 00000100:00100000:3.0:1787882644.432973:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:10533:x1874730541956608:12345-192.168.206.21@tcp:101:bash.0 Request processed in 4071us (4256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882644.432981:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:2.0:1787882644.433204:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541956736 00000100:00100000:2.0:1787882644.433211:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541956736 00010000:00010000:2.0:1787882644.433240:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df4b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843150 expref: 7 pid: 9930 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882644.433270:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:2.0:1787882644.433278:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d850850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541956736:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882644.433290:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882644.433310:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df4b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843150 expref: 7 pid: 9930 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.433323:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df4b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843150 expref: 7 pid: 9930 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.433346:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df4b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843150 expref: 7 pid: 9930 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.433367:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882644.433371:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882644.433379:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.433388:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.433417:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882644.433429:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1874730563993856:192.168.206.21@tcp:105: 00000100:00100000:2.0:1787882644.433487:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2839413c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882644.438133:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.439076:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541956992 00000100:00100000:0.0:1787882644.439088:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541956992 00000100:00100000:0.0:1787882644.439155:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:0.0:1787882644.439166:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:10533:x1874730541956992:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:0.0:1787882644.439553:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:10533:x1874730541956992:12345-192.168.206.21@tcp:35:bash.0 Request processed in 388us (1429us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787882644.439562:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:2.0:1787882644.445845:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1874730563993856:192.168.206.21@tcp:105: 00010000:00010000:2.0:1787882644.445896:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882644.445975:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d850850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541956736:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 12695us (13294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882644.445987:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 49 00010000:00010000:3.0:1787882644.587033:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882644.621033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882644.621102:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541957120 00000100:00100000:2.0:1787882644.621111:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541957120 00000100:00100000:2.0:1787882644.621365:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00100000:2.0:1787882644.621377:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:10549:x1874730541957120:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882644.621398:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882644.621417:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df4c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84315e expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.621501:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df4ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.621514:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df4ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.621525:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df4ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882644.621582:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787882644.621586:0:6733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882644.621608:0:6733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df4ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.621633:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df4c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84315e expref: 36 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.621651:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df4ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84315e expref: 35 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.621659:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:2.0:1787882644.621662:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787882644.621827:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265600, rc 0) 00000100:00100000:2.0:1787882644.621951:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:10549:x1874730541957120:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 575us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882644.621959:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00100000:0.0:1787882644.626329:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882644.628907:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541957376 00000100:00100000:2.0:1787882644.628920:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541957376 00000100:00100000:2.0:1787882644.629049:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 98 00000100:00100000:2.0:1787882644.629060:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:10549:x1874730541957376:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882644.629078:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882644.629096:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df4d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843165 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.629202:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df4dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.629216:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df4dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.629227:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df4dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882644.629237:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787882644.629350:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df4d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843165 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.629367:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df4dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843165 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.629376:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa2a0727400) 00010000:00010000:2.0:1787882644.629379:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787882644.629382:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264400, rc 0) 00000100:00100000:2.0:1787882644.629447:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:10549:x1874730541957376:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 389us (3127us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787882644.629454:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 98 00000100:00100000:1.0:1787882644.635611:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882644.635657:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.635799:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541957760 00000100:00100000:0.0:1787882644.635818:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541957760 00000100:00100000:0.0:1787882644.635908:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 99 00000100:00100000:0.0:1787882644.635920:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:10549:x1874730541957760:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1787882644.635943:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882644.635963:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df4ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84316c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.636059:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df4f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.636087:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df4f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.636098:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df4f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882644.636111:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787882644.636228:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df4ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84316c expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.636245:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df4f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84316c expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.636254:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa2a0727400) 00010000:00010000:0.0:1787882644.636257:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787882644.636260:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8400, rc 0) 00000100:00100000:0.0:1787882644.636313:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+39:10549:x1874730541957760:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 395us (655us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787882644.636320:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 99 00000100:00100000:2.0:1787882644.639195:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541957504 00000100:00100000:2.0:1787882644.639227:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541957504 00000100:00100000:2.0:1787882644.639305:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:2.0:1787882644.639316:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+39:2356:x1874730541957504:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882644.639332:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882644.639359:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df4dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843165 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.639379:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa2a0727400) 00010000:00010000:2.0:1787882644.639384:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882644.639457:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:2356:x1874730541957504:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 143us (3855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882644.639464:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:1.0:1787882644.649990:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882644.650107:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541957888 00000100:00100000:3.0:1787882644.650123:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541957888 00000100:00100000:3.0:1787882644.650184:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:3.0:1787882644.650193:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541957888:12345-192.168.206.21@tcp:1:lfs.0 00010000:00010000:3.0:1787882644.650235:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.650255:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.650267:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882644.650272:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787882644.650279:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.650320:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 6 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.650349:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 6 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882644.650386:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6711:1874730563993984:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882644.650750:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28601ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787882644.653831:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6711:1874730563993984:192.168.206.21@tcp:104: 00010000:00010000:3.0:1787882644.653860:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882644.660131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882644.660411:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541958016 00000100:00100000:2.0:1787882644.660427:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541958016 00002000:00100000:2.0:1787882644.660488:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fa2af7cd500 x1874730541958016/t0(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:375/0 lens 504/0 e 0 to 0 dl 1787882655 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787882644.660499:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2af7cd500 with x1874730541958016 ext(0->8) 00010000:00010000:2.0:1787882644.660508:0:6716:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 7 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.660526:0:6716:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 7 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882644.660534:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa2af7cd500 00000100:00100000:2.0:1787882644.660587:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:2.0:1787882644.660598:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730541958016:12345-192.168.206.21@tcp:4:lfs.0 00000100:00100000:2.0:1787882644.661848:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2356:x1874730541958016:12345-192.168.206.21@tcp:4:lfs.0 Request processed in 1245us (1723us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787882644.661859:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00002000:00100000:2.0:1787882644.661867:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fa2af7cd500 x1874730541958016/t4294967302(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:375/0 lens 504/448 e 0 to 0 dl 1787882655 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787882644.661896:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2af7cd500 with x1874730541958016 ext(0->8) 00010000:00010000:2.0:1787882644.661904:0:6716:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 9 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.661920:0:6716:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 9 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882644.661928:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa2af7cd500 00000100:00100000:1.0:1787882644.668224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882644.668688:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541958144 00000100:00100000:3.0:1787882644.668698:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541958144 00010000:00010000:3.0:1787882644.668739:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 9 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882644.668784:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:3.0:1787882644.668793:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2359:x1874730541958144:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882644.668819:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787882644.668985:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787882644.668989:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787882644 00002000:00010000:3.0:1787882644.668992:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787882644 00002000:00010000:3.0:1787882644.668994:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787882644 00010000:00010000:3.0:1787882644.669001:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 9 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.669015:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 9 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.669057:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a52c5a1/0xf4731e8a7c5df4c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843157 expref: 9 pid: 6710 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.669072:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787882644.669077:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787882644.669082:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.669092:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.669117:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882644.669183:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2359:x1874730541958144:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 390us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882644.669190:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00010000:00010000:0.0:1787882644.669266:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.669276:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.669299:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.669318:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.669325:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.669332:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce400 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882644.669336:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.669345:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.669358:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.669366:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000242a8be0/0xf4731e8a7c5df4ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882644.669413:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541957888:12345-192.168.206.21@tcp:1:lfs.0 Request processed in 19221us (19431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882644.669420:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:3.0:1787882644.675952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.676101:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541958400 00000100:00100000:0.0:1787882644.676110:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541958400 00000100:00100000:0.0:1787882644.676177:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:0.0:1787882644.676202:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa288323450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:10549:x1874730541958400:12345-192.168.206.21@tcp:35:lfs.0 00000004:00010000:0.0:1787882644.676264:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df4f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84316c expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787882644.676534:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787882644.676589:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787882644.676939:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787882644.676992:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.677007:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df4ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843149 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.677016:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.677048:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df4ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843149 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.677062:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df4ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843149 expref: 42 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882644.677075:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1874730563994112:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882644.677158:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479480 going to sleep for 11 seconds 00000100:00100000:0.0:1787882644.680722:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1874730563994112:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882644.680752:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882644.681837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882644.681998:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541958528 00000100:00100000:2.0:1787882644.682007:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541958528 00010000:00010000:2.0:1787882644.682043:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df4ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843149 expref: 43 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882644.682084:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:2.0:1787882644.682094:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+43:2357:x1874730541958528:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882644.682108:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882644.682114:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df4ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843149 expref: 43 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.682127:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df4ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843149 expref: 43 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.682173:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df4ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843149 expref: 43 pid: 5844 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.682188:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa2a0727400) 00010000:00010000:2.0:1787882644.682192:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.682202:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.682209:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.682238:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882644.682297:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+42:2357:x1874730541958528:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 204us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882644.682307:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00010000:00010000:0.0:1787882644.682568:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.682582:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787882644.682706:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787882644.683580:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787882644.684407:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874730563994240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787882644.684468:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882644.684504:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787882644.684790:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563994240 00000100:00100000:3.0:1787882644.684798:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563994240 00000100:00100000:3.0:1787882644.685084:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787882644.685094:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874730563994240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787882644.685198:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874730563994240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 105us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882644.685205:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787882644.685266:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787882644.685425:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787882644.685431:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787882644.685453:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2bf43d180, transno 4294967301 00000100:00100000:1.0:1787882644.685470:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874730563994240:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787882644.686010:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787882644.686090:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7cd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874730563994368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787882644.686133:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882644.687511:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2861a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787882644.687654:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563994368 00000100:00100000:2.0:1787882644.687663:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563994368 00000100:00100000:2.0:1787882644.687771:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787882644.687780:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874730563994368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787882644.688451:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1874730563994368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 669us (2314us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787882644.688459:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787882644.688530:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7cd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874730563994368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787882644.688746:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787882644.688793:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.688815:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.689019:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.689026:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882644.689031:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.689039:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.689057:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa2a0727400) 00010000:00010000:1.0:1787882644.689060:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787882644.689064:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.689070:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5df506 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787882644.689252:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787882644.689344:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1787882644.689354:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360838483611ns, next at 361838481423ns, rc = 0 00000001:00080000:1.0:1787882644.689361:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787882644.689394:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa2a0727400) 00010000:00010000:1.0:1787882644.689397:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787882644.689404:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df4f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84316c expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882644.689565:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa288323450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+45:10549:x1874730541958400:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 13365us (13621us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787882644.689595:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00000020:00080000:1.0:1787882644.689599:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787882644.692813:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882644.693095:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541958656 00000100:00100000:2.0:1787882644.693105:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541958656 00000100:00100000:2.0:1787882644.693192:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 100 00000100:00100000:2.0:1787882644.693202:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+45:10549:x1874730541958656:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882644.693232:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882644.693256:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df50d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843173 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.693319:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df50d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843173 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.693333:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df50d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843173 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882644.693354:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:2.0:1787882644.693357:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787882644.693361:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264400, rc 0) 00000100:00100000:2.0:1787882644.693457:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+46:10549:x1874730541958656:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 256us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882644.693464:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 100 00000100:00100000:0.0:1787882644.697197:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882644.697495:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541958912 00000100:00100000:3.0:1787882644.697505:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541958912 00000100:00100000:3.0:1787882644.697559:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:3.0:1787882644.697570:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+46:10549:x1874730541958912:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1787882644.697930:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+47:10549:x1874730541958912:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 360us (740us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787882644.697938:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:1.0:1787882644.799866:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.799988:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541959040 00000100:00100000:0.0:1787882644.799999:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541959040 00000100:00100000:0.0:1787882644.800060:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 101 00000100:00100000:0.0:1787882644.800070:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+47:10559:x1874730541959040:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:0.0:1787882644.800168:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df514 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800185:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df514 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800196:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df514 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800212:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df51b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800244:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df51b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800251:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df51b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800353:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df522 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800363:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800369:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787882644.800410:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800422:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df514 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800429:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df514 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800435:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df514 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800442:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.800446:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df514 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800453:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df514 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800473:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:0.0:1787882644.800476:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882644.800481:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df514 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800488:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df514 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800501:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df51b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800507:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df51b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800513:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df51b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800519:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.800522:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df51b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800527:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df51b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800534:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa289160e00) 00010000:00010000:0.0:1787882644.800536:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882644.800538:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df51b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800543:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df51b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800581:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800587:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df522 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800593:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800598:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882644.800601:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800607:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df522 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800615:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:0.0:1787882644.800617:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882644.800620:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df522 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.800625:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df522 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882644.800710:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+47:10559:x1874730541959040:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 640us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882644.800718:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 101 00000100:00100000:0.0:1787882644.851668:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882644.851765:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541959296 00000100:00100000:1.0:1787882644.851775:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541959296 00000100:00100000:1.0:1787882644.851843:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 102 00000100:00100000:1.0:1787882644.851856:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+47:10562:x1874730541959296:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1787882644.851902:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882644.851923:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5df529 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84317a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.851995:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df530 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852010:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852024:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852038:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852045:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852051:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852199:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5df53e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852220:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5df53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852227:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5df53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882644.852238:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787882644.852334:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852343:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df530 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852349:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df530 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852354:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882644.852359:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df530 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852366:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df530 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852378:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:1.0:1787882644.852381:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882644.852385:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df530 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852392:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5df530 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852405:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852416:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df537 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852422:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852426:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882644.852445:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852452:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df537 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852462:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa283291a00) 00010000:00010000:1.0:1787882644.852465:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882644.852468:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df537 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852473:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852512:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5df529 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84317a expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852526:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5df53e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84317a expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.852534:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:1.0:1787882644.852536:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787882644.852545:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa7c00, rc 0) 00000100:00100000:1.0:1787882644.852611:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+49:10562:x1874730541959296:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 758us (953us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787882644.852619:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 102 00000100:00100000:1.0:1787882644.855927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882644.856188:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541959424 00000100:00100000:3.0:1787882644.856198:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541959424 00000100:00100000:3.0:1787882644.856257:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 103 00000100:00100000:3.0:1787882644.856267:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+49:10562:x1874730541959424:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:3.0:1787882644.856349:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df54c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.856366:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df54c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.856378:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df54c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.856403:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df54c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.856410:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df54c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.856418:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df54c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.856424:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cee00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882644.856454:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df54c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.856462:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df54c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.856474:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:3.0:1787882644.856477:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787882644.856481:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df54c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.856488:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df54c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882644.856569:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+49:10562:x1874730541959424:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 302us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882644.857137:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 103 00000100:00100000:0.0:1787882644.858450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882644.858521:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541959680 00000100:00100000:1.0:1787882644.858530:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541959680 00000100:00100000:1.0:1787882644.858594:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:1.0:1787882644.858604:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+49:10562:x1874730541959680:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:1.0:1787882644.858836:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+50:10562:x1874730541959680:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 232us (403us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787882644.858843:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:1.0:1787882644.970009:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.970143:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541959936 00000100:00100000:0.0:1787882644.970178:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541959936 00000100:00100000:0.0:1787882644.970265:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00100000:0.0:1787882644.970278:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+50:10572:x1874730541959936:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1787882644.970305:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882644.970308:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787882644.970334:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df4ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84315e expref: 50 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.970353:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:0.0:1787882644.970359:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787882644.970374:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df553 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843181 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.970483:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.970495:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.970504:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882644.970514:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787882644.970636:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df553 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843181 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.970650:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843181 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.970659:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:0.0:1787882644.970669:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882644.970672:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9400, rc 0) 00000100:00100000:0.0:1787882644.970742:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+51:10572:x1874730541959936:12345-192.168.206.21@tcp:101:bash.0 Request processed in 467us (749us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787882644.970750:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00100000:0.0:1787882644.977015:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.977069:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882644.977188:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541960320 00000100:00100000:1.0:1787882644.977204:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541960320 00000100:00100000:1.0:1787882644.977288:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 105 00000100:00100000:1.0:1787882644.977301:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+51:10572:x1874730541960320:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:1.0:1787882644.977381:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882644.977419:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5df53e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84317a expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.977443:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:1.0:1787882644.977449:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787882644.977734:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.977750:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843181 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.977778:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.977830:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843181 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882644.977846:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843181 expref: 51 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882644.977863:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730563994496:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882644.977961:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541960064 00000100:00100000:3.0:1787882644.977973:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541960064 00010000:00010000:3.0:1787882644.978023:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843181 expref: 52 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882644.978065:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:3.0:1787882644.978075:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+52:2356:x1874730541960064:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882644.978090:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882644.978097:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 6/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843181 expref: 52 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.978111:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843181 expref: 52 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.978147:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:3.0:1787882644.978152:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.978162:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.978168:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.978187:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882644.978247:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+52:2356:x1874730541960064:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 172us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882644.978255:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:0.0:1787882644.978495:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a9891780 going to sleep for 11 seconds 00010000:00010000:0.0:1787882644.984115:0:5843:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.21@tcp) returned -22 from blocking AST (req@00000000c3287d53 x1874730563994496) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843181 expref: 51 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.984158:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df55a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843181 expref: 51 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882644.984181:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730563994496:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882644.984213:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:0.0:1787882644.984223:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.984233:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.984240:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787882644.984395:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787882644.984727:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b32c2767 reply state 00000000d57d5902 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882644.984761:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787882644.985047:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+52:10572:x1874730541960320:12345-192.168.206.21@tcp:36:bash.0 Request processed in 7735us (7964us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787882644.985057:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 105 00000020:00080000:0.0:1787882644.985263:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787882644.994408:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.994431:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.994439:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.994445:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882644.994451:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.994469:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.994516:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:3.0:1787882644.994519:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882644.994524:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882644.994530:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df568 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882644.996012:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882644.996283:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541960448 00000100:00100000:0.0:1787882644.996297:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541960448 00000100:00100000:0.0:1787882644.996363:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 106 00000100:00100000:0.0:1787882644.996376:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+51:10572:x1874730541960448:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1787882644.996407:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882644.996430:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df56f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843188 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.996559:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.997167:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.997193:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882644.997247:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787882644.997252:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882644.997274:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.997317:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df56f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843188 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.997363:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843188 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882644.997372:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:0.0:1787882644.997375:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882644.997379:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9a00, rc 0) 00000100:00100000:0.0:1787882644.997665:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+52:10572:x1874730541960448:12345-192.168.206.21@tcp:101:bash.0 Request processed in 1289us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882644.997678:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 106 00000100:00100000:1.0:1787882645.010824:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882645.013276:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541960704 00000100:00100000:0.0:1787882645.013295:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541960704 00000100:00100000:1.0:1787882645.013724:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:1.0:1787882645.013739:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+52:10572:x1874730541960704:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:1.0:1787882645.014137:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+53:10572:x1874730541960704:12345-192.168.206.21@tcp:35:bash.0 Request processed in 400us (3342us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787882645.014648:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00080000:0.0:1787882645.016349:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882645.111661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882645.111776:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541960832 00000100:00100000:3.0:1787882645.111788:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541960832 00000100:00100000:3.0:1787882645.111899:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 107 00000100:00100000:3.0:1787882645.111911:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+53:10578:x1874730541960832:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882645.111939:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882645.111963:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df57d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84318f expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.112040:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df584 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.112056:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.112069:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882645.112378:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787882645.112383:0:6733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882645.112456:0:6733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.112516:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cee00/0xf4731e8a7c5df57d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84318f expref: 55 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.112538:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df584 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84318f expref: 54 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.112548:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:3.0:1787882645.112551:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787882645.112555:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67cfa00, rc 0) 00000100:00100000:3.0:1787882645.112627:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+54:10578:x1874730541960832:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 718us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882645.112635:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 107 00000100:00100000:2.0:1787882645.117360:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882645.117463:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541960960 00000100:00100000:3.0:1787882645.117476:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541960960 00000100:00100000:3.0:1787882645.117558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 108 00000100:00100000:3.0:1787882645.117580:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+54:10578:x1874730541960960:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882645.117605:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882645.117633:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df58b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843196 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.117718:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df592 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.117733:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df592 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.117745:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df592 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.117777:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df599 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.117784:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.117791:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.117984:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5df5a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.117993:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5df5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118000:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5df5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882645.118059:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787882645.118065:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882645.118091:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5df5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118106:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5df5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118116:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df592 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118261:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df592 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118282:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df592 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118289:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882645.118295:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df592 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118304:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df592 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118321:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:3.0:1787882645.118325:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882645.118330:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df592 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118337:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce400/0xf4731e8a7c5df592 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118356:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df599 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118362:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df599 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118367:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118372:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882645.118375:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df599 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118392:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df599 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118400:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa2a0727300) 00010000:00010000:3.0:1787882645.118402:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882645.118405:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df599 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118411:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67ce000/0xf4731e8a7c5df599 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118451:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf000/0xf4731e8a7c5df58b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843196 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118465:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5df5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843196 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.118473:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:3.0:1787882645.118475:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882645.118478:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030600, rc 0) 00000100:00100000:3.0:1787882645.118554:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:10578:x1874730541960960:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 984us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882645.118562:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 108 00000100:00100000:1.0:1787882645.125272:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882645.126274:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541961088 00000100:00100000:2.0:1787882645.126295:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541961088 00000100:00100000:2.0:1787882645.126392:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:2.0:1787882645.126405:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:2357:x1874730541961088:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882645.126428:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882645.127413:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5df5a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843196 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882645.127449:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:2.0:1787882645.127749:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882645.127761:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882645.127846:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541961344 00000100:00100000:0.0:1787882645.127854:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541961344 00000100:00100000:0.0:1787882645.127926:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 109 00000100:00100000:0.0:1787882645.127937:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:10578:x1874730541961344:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1787882645.127959:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882645.127983:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df5a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84319d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882645.128101:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882645.128118:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843188 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882645.128126:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882645.128178:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843188 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882645.128193:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843188 expref: 56 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882645.128209:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730563994624:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882645.128284:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+56:2357:x1874730541961088:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1880us (3024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882645.128295:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1787882645.128313:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479540 going to sleep for 11 seconds 00000100:00100000:1.0:1787882645.133496:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882645.133831:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730563994624:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882645.133896:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882645.134270:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541961472 00000100:00100000:2.0:1787882645.134279:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541961472 00010000:00010000:2.0:1787882645.134326:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843188 expref: 56 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882645.134379:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:2.0:1787882645.134390:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+56:2357:x1874730541961472:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882645.134412:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882645.134421:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843188 expref: 56 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882645.134437:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843188 expref: 56 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882645.134644:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df576 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843188 expref: 56 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882645.134666:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:2.0:1787882645.134671:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882645.134682:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882645.134690:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882645.134741:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882645.134824:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:2357:x1874730541961472:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 435us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882645.134833:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00010000:00010000:0.0:1787882645.135356:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882645.135367:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882645.135392:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787882645.135854:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df5a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84319d expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882645.135900:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84319d expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882645.135910:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:0.0:1787882645.135913:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787882645.135929:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8000, rc 0) 00000100:00100000:0.0:1787882645.135992:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:10578:x1874730541961344:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 8056us (8233us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787882645.136002:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 109 00000100:00100000:1.0:1787882645.139904:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882645.140588:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541961728 00000100:00100000:3.0:1787882645.140602:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541961728 00000100:00100000:3.0:1787882645.140690:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1787882645.140702:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d851850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:10578:x1874730541961728:12345-192.168.206.21@tcp:103:lfs.0 00010000:00010000:3.0:1787882645.140750:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882645.140785:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df50d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843173 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.140819:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:3.0:1787882645.140826:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882645.140939:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d851850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+54:10578:x1874730541961728:12345-192.168.206.21@tcp:103:lfs.0 Request processed in 238us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882645.140947:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1787882645.144655:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882645.144850:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541961856 00000100:00100000:2.0:1787882645.144864:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541961856 00000100:00100000:2.0:1787882645.144976:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 110 00000100:00100000:2.0:1787882645.144988:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+54:10578:x1874730541961856:12345-192.168.206.21@tcp:58:lfs.0 00010000:00010000:2.0:1787882645.145279:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882645.145301:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882645.145315:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787882645.145734:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787882645.145853:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+54:10578:x1874730541961856:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 865us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882645.145863:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 110 00000100:00100000:1.0:1787882645.149030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882645.149144:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541961984 00000100:00100000:3.0:1787882645.149158:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541961984 00000100:00100000:3.0:1787882645.149289:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 111 00000100:00100000:3.0:1787882645.149303:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+54:10578:x1874730541961984:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882645.149331:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882645.149361:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031600/0xf4731e8a7c5df5c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431a4 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.149436:0:6733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.149448:0:6733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031600/0xf4731e8a7c5df5c3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431a4 expref: 55 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.149485:0:6733:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.149500:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031600/0xf4731e8a7c5df5c3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431a4 expref: 55 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.149535:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:3.0:1787882645.149539:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787882645.149544:0:6733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031600/0xf4731e8a7c5df5c3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431a4 expref: 55 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882645.149563:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031600, rc 0) 00000100:00100000:3.0:1787882645.149650:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:10578:x1874730541961984:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 350us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882645.149659:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 111 00010000:00010000:0.0:1787882645.610154:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882645.802289:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b6168a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563995136:0@lo:400:kworker.0 00000100:00100000:3.0:1787882645.802389:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882645.802489:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787882645.802497:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b6168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563995008:0@lo:400:kworker.0 00000100:00100000:3.0:1787882645.802681:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882645.802727:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563995136 00000100:00100000:3.0:1787882645.802737:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563995136 00000100:00100000:3.0:1787882645.802810:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787882645.802822:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730563995136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882645.807038:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730563995136:12345-0@lo:400:kworker.0 Request processed in 4202us (4634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882645.807057:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787882645.807173:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b6168a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563995136:0@lo:400:kworker.0 00000100:00100000:2.0:1787882645.807355:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b6169880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563994880:0@lo:400:kworker.0 00000100:00100000:2.0:1787882645.807442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882645.807474:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b6169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563995392:0@lo:400:kworker.0 00000100:00100000:2.0:1787882645.807500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882645.807554:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787882645.807562:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563994752:0@lo:400:kworker.0 00000100:00100000:2.0:1787882645.807611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882645.807639:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563995264:0@lo:400:kworker.0 00000100:00100000:2.0:1787882645.807663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882645.807692:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563994752 00000100:00100000:2.0:1787882645.807698:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563994752 00000100:00100000:2.0:1787882645.807752:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787882645.807762:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563994752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882645.807832:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730563994752:12345-0@lo:400:kworker.0 Request processed in 71us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882645.807839:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000004:00080000:0.0:1787882645.808071:0:7112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361957200022ns, next at 362957197049ns, rc = 0 00000100:00100000:0.0:1787882645.808100:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563995520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882645.808140:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882645.808211:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563995008 00000100:00100000:1.0:1787882645.808217:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563995008 00000100:00080000:1.0:1787882645.808248:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882645.808294:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563994880 00000100:00100000:1.0:1787882645.808297:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563994880 00000100:00100000:1.0:1787882645.808310:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563995264 00000100:00100000:1.0:1787882645.808313:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563995264 00000100:00080000:1.0:1787882645.808327:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882645.808343:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787882645.808352:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563995008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882645.808395:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730563995008:12345-0@lo:400:kworker.0 Request processed in 45us (5866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882645.808401:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787882645.808448:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787882645.808455:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563994880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882645.808494:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730563994752:0@lo:400:kworker.0 00000100:00100000:3.0:1787882645.808681:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787882645.808692:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563995264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882645.808762:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b6168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730563995008:0@lo:400:kworker.0 00000100:00100000:0.0:1787882645.808808:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563995520 00000100:00100000:0.0:1787882645.808812:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563995520 00000100:00100000:0.0:1787882645.808840:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787882645.808846:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730563995520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882645.808864:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882645.808923:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730563995520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882645.808930:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787882645.808977:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563995520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882645.809099:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563995392 00000100:00100000:0.0:1787882645.809103:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563995392 00000100:00100000:0.0:1787882645.809140:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787882645.809301:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874730563995392:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787882645.812912:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787882645.815741:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563994880:12345-0@lo:400:kworker.0 Request processed in 7269us (8282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882645.815761:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787882645.821276:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874730563995392:12345-0@lo:400:kworker.0 Request processed in 12115us (13760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882645.821297:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787882645.823275:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730563995264:12345-0@lo:400:kworker.0 Request processed in 14574us (15598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882645.823292:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787882645.824836:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730563995264:0@lo:400:kworker.0 00000100:00100000:2.0:1787882645.824864:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b6169880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563994880:0@lo:400:kworker.0 00000100:00100000:2.0:1787882645.825628:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b6169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563995392:0@lo:400:kworker.0 00000040:00080000:0.0:1787882646.122260:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882646.122289:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882646.122333:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787882646.122341:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787882646.122488:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730563995648:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787882646.122638:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787882646.142767:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882646.142817:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730563995648:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787882646.143288:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541962112 00000100:00100000:2.0:1787882646.143297:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541962112 00000100:00100000:2.0:1787882646.143493:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 112 00000100:00100000:2.0:1787882646.143506:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:10579:x1874730541962112:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787882646.143536:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787882646.143640:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:10579:x1874730541962112:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 136us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882646.143649:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 112 00000100:00100000:0.0:1787882646.152780:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.153125:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541962240 00000100:00100000:2.0:1787882646.153147:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541962240 00000100:00100000:2.0:1787882646.153248:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00100000:2.0:1787882646.153259:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:10579:x1874730541962240:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787882646.153345:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df5ca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153362:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df5ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153375:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df5ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153428:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df5d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153436:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153443:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153608:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df5d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153618:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153625:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882646.153663:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787882646.153677:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882646.153697:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153709:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df5ca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153715:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df5ca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153721:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df5ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153727:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882646.153731:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df5ca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153738:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df5ca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153750:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:2.0:1787882646.153753:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882646.153758:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df5ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153764:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df5ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153775:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153781:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df5d1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.153787:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df5d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.154071:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882646.154075:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df5d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.154081:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df5d1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.154091:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9fa285a00c00) 00010000:00010000:2.0:1787882646.154093:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882646.154097:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df5d1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.154101:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df5d1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.154121:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.154126:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df5d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.154131:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df5d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.154136:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882646.154138:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df5d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.154144:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df5d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.154162:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:2.0:1787882646.154164:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882646.154167:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df5d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.154172:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df5d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.154265:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:10579:x1874730541962240:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 Request processed in 1006us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882646.154273:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00100000:3.0:1787882646.158302:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.158444:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541962496 00000100:00100000:2.0:1787882646.158467:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541962496 00000100:00100000:2.0:1787882646.158543:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 114 00000100:00100000:2.0:1787882646.158554:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:10579:x1874730541962496:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882646.158573:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882646.158606:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df5df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431ab expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.158714:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df5e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.158729:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.158739:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882646.158749:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787882646.159157:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.159166:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df5e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.159172:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.159178:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882646.159183:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.159190:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.159202:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:2.0:1787882646.159205:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787882646.159209:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df5e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.159214:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df5e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.159258:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df5df lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ab expref: 57 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.159268:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:2.0:1787882646.159270:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787882646.159274:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df5df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ab expref: 57 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.159297:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265c00, rc 0) 00000100:00100000:2.0:1787882646.159447:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+56:10579:x1874730541962496:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 893us (1159us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787882646.159455:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 114 00000100:00100000:1.0:1787882646.162583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.162653:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541962624 00000100:00100000:2.0:1787882646.162677:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541962624 00000100:00100000:2.0:1787882646.162744:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:2.0:1787882646.162755:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+56:10579:x1874730541962624:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787882646.162789:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787882646.163142:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+56:10579:x1874730541962624:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 386us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882646.163151:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:1.0:1787882646.172375:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882646.173146:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541962880 00000100:00100000:3.0:1787882646.173159:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541962880 00000100:00100000:3.0:1787882646.173233:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:3.0:1787882646.173245:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+56:10579:x1874730541962880:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882646.173271:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882646.173275:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787882646.173310:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cfa00/0xf4731e8a7c5df584 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84318f expref: 56 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.173346:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:3.0:1787882646.173352:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787882646.173368:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5df5f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431b2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787882646.174272:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787882646.175018:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5df5fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.175037:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5df5fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.175051:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5df5fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.175826:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5df5f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b2 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.175906:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5df5fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b2 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.175916:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa2a0727300) 00010000:00010000:3.0:1787882646.175920:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882646.175923:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031e00, rc 0) 00000100:00100000:3.0:1787882646.176084:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+57:10579:x1874730541962880:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 2839us (3721us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787882646.176096:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:2.0:1787882646.192764:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882646.193414:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541963136 00000100:00100000:1.0:1787882646.193429:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541963136 00000100:00100000:1.0:1787882646.193653:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 117 00000100:00100000:1.0:1787882646.193731:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+57:10579:x1874730541963136:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787882646.193822:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882646.193855:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5df5fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b2 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.194552:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa2a0727300) 00010000:00010000:1.0:1787882646.194742:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787882646.194773:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df609 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.194800:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df609 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.194813:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df609 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.194828:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5df610 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xea18ea55 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.194836:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5df610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xea18ea55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.194842:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5df610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xea18ea55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.194978:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df609 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.194986:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df609 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.194993:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df609 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.194999:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882646.195004:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df609 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.195013:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df609 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.195030:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:1.0:1787882646.195033:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882646.195037:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df609 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.195043:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df609 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.195054:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5df610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xea18ea55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.195060:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5df610 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xea18ea55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.195066:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5df610 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xea18ea55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.195072:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882646.195075:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5df610 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xea18ea55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.195080:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5df610 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xea18ea55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.195086:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xea18ea55 (ffff9fa283291a00) 00010000:00010000:1.0:1787882646.195088:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882646.195090:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5df610 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xea18ea55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.195096:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5df610 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xea18ea55 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882646.196841:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+56:10579:x1874730541963136:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 3100us (4077us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787882646.196857:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 117 00000100:00100000:1.0:1787882646.202611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.203143:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541963264 00000100:00100000:2.0:1787882646.203159:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541963264 00000100:00100000:2.0:1787882646.203239:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:2.0:1787882646.203252:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+56:10579:x1874730541963264:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882646.203279:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882646.203308:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df617 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431b9 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.203364:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df61e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.203380:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df61e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.203413:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df61e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.203545:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df617 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b9 expref: 58 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.203775:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df61e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b9 expref: 57 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.203787:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:2.0:1787882646.203790:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787882646.203805:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265600, rc 0) 00000100:00100000:2.0:1787882646.203990:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+57:10579:x1874730541963264:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 739us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882646.203999:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:0.0:1787882646.220402:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.220705:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541963520 00000100:00100000:2.0:1787882646.220718:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541963520 00000100:00100000:2.0:1787882646.220790:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 119 00000100:00100000:2.0:1787882646.220813:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+57:10579:x1874730541963520:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787882646.220962:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df625 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.220983:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.220997:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787882646.221351:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1787882646.221364:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362370493541ns, next at 363370490496ns, rc = 0 00000004:00010000:2.0:1787882646.221774:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a6d8baf reply state 00000000f3646844 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.221787:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787882646.221962:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:10579:x1874730541963520:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 1149us (1571us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787882646.221971:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 119 00010000:00010000:3.0:1787882646.227026:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.227050:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df625 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.227060:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df625 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.227077:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882646.227083:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df625 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.227092:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df625 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.227113:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:3.0:1787882646.227116:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787882646.227121:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df625 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.227156:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df625 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882646.229492:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.230338:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541963648 00000100:00100000:2.0:1787882646.230354:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541963648 00000100:00100000:2.0:1787882646.230434:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:2.0:1787882646.230446:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+58:10579:x1874730541963648:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882646.230485:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882646.230511:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df62c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431c0 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.230606:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df62c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c0 expref: 59 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.230623:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df62c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c0 expref: 59 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.230646:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:2.0:1787882646.230650:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787882646.230654:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264400, rc 0) 00000100:00100000:2.0:1787882646.230775:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:10579:x1874730541963648:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 330us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882646.230785:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:0.0:1787882646.240001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882646.240117:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541963776 00000100:00100000:3.0:1787882646.240130:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541963776 00000100:00100000:3.0:1787882646.240232:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:3.0:1787882646.240245:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730541963776:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787882646.240660:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2356:x1874730541963776:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 417us (674us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787882646.240669:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00080000:2.0:1787882646.241312:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787882646.244672:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882646.244927:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541964032 00000100:00100000:1.0:1787882646.244942:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541964032 00000100:00100000:1.0:1787882646.245017:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:1.0:1787882646.245030:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:10579:x1874730541964032:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787882646.245363:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:10579:x1874730541964032:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 335us (715us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787882646.245371:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:1.0:1787882646.247764:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.247920:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541964288 00000100:00100000:2.0:1787882646.247932:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541964288 00000100:00100000:2.0:1787882646.247997:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:2.0:1787882646.248008:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:10579:x1874730541964288:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787882646.248197:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:10579:x1874730541964288:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 190us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882646.248206:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:0.0:1787882646.261227:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.266730:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541964416 00000100:00100000:2.0:1787882646.266756:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541964416 00000100:00100000:2.0:1787882646.266908:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:2.0:1787882646.266920:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:10579:x1874730541964416:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882646.266947:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882646.266974:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df633 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431c7 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.267085:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df63a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.267104:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df63a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.267119:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df63a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882646.267203:0:6733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882646.267229:0:6733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df63a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.267262:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df633 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c7 expref: 62 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.267283:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df63a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c7 expref: 61 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.267293:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:2.0:1787882646.267297:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787882646.267301:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264e00, rc 0) 00000100:00100000:2.0:1787882646.267415:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:10579:x1874730541964416:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 487us (6191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882646.267422:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:0.0:1787882646.279594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.279928:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541964544 00000100:00100000:2.0:1787882646.279941:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541964544 00000100:00100000:2.0:1787882646.280005:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:2.0:1787882646.280018:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2357:x1874730541964544:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882646.280043:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882646.280074:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df641 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431ce expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882646.280111:0:6711:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90ec95, blocks: 0x1 00010000:00010000:2.0:1787882646.280197:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1787882646.280219:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882646.280230:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ce expref: 10 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.280255:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ce expref: 10 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.280275:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264800, rc 0) 00000100:00100000:2.0:1787882646.280494:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:2357:x1874730541964544:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 476us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882646.280502:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:1.0:1787882646.291442:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.293775:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541964800 00000100:00100000:2.0:1787882646.293804:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541964800 00000100:00100000:2.0:1787882646.293922:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:2.0:1787882646.293936:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:10579:x1874730541964800:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787882646.294103:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:10579:x1874730541964800:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 170us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882646.294113:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:1.0:1787882646.301303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882646.309774:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541964928 00000100:00100000:3.0:1787882646.309807:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541964928 00000100:00100000:3.0:1787882646.314769:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563995776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882646.314901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882646.315421:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563995776 00000100:00100000:1.0:1787882646.315432:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563995776 00000100:00100000:1.0:1787882646.315507:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787882646.315520:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730563995776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882646.316056:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882646.317025:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730563995776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1422us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882646.317040:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787882646.317200:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563995776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787882646.318309:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:0.0:1787882646.319061:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:10579:x1874730541964928:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882646.319201:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882646.319230:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431d5 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.319277:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df641 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ce expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.319288:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882646.319293:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882646.319298:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 11 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.320286:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ce expref: 11 pid: 6711 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.320308:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df641 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ce expref: 11 pid: 6711 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882646.320397:0:6709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1874730563995904:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882646.320810:0:6709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787882646.332268:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.333517:0:6709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1874730563995904:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882646.333582:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 11 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.333610:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8600, rc 0) 00000100:00100000:2.0:1787882646.333720:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:10579:x1874730541964928:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 15398us (32431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882646.333748:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:1.0:1787882646.335825:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541965056 00000100:00100000:1.0:1787882646.335844:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541965056 00010000:00010000:1.0:1787882646.335952:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df641 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ce expref: 11 pid: 6711 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882646.336019:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:1.0:1787882646.336032:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:2356:x1874730541965056:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882646.336049:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882646.336089:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df641 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ce expref: 11 pid: 6711 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.336105:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ce expref: 11 pid: 6711 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.336133:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df641 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ce expref: 11 pid: 6711 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.336151:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882646.336157:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882646.336166:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 10 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.336178:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 10 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.336225:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 10 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882646.336242:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1874730563996032:192.168.206.21@tcp:105: 00000100:00100000:1.0:1787882646.336572:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a9891540 going to sleep for 11 seconds 00000100:00100000:0.0:1787882646.349748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882646.350937:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541965184 00000100:00100000:3.0:1787882646.350962:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541965184 00002000:00100000:3.0:1787882646.351031:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fa2af7e9f80 x1874730541965184/t0(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:377/0 lens 504/0 e 0 to 0 dl 1787882657 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787882646.351044:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2af7e9f80 with x1874730541965184 ext(0->12) 00002000:00010000:3.0:1787882646.351050:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2af7e9f80 00000100:00100000:3.0:1787882646.351147:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:3.0:1787882646.351160:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:2356:x1874730541965184:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787882646.351807:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2356:x1874730541965184:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 Request processed in 636us (2058us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787882646.351821:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00002000:00100000:3.0:1787882646.351831:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fa2af7e9f80 x1874730541965184/t4294967308(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:377/0 lens 504/448 e 0 to 0 dl 1787882657 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787882646.351839:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2af7e9f80 with x1874730541965184 ext(0->12) 00002000:00010000:3.0:1787882646.351843:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2af7e9f80 00000100:00100000:1.0:1787882646.357235:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7fb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1874730563996032:192.168.206.21@tcp:105: 00010000:00010000:1.0:1787882646.357277:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882646.357787:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+12:2356:x1874730541965056:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 21752us (25725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882646.357811:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:0.0:1787882646.361059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882646.361213:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541965312 00000100:00100000:3.0:1787882646.361226:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541965312 00000100:00100000:3.0:1787882646.361298:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 124 00000100:00100000:3.0:1787882646.361311:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:10579:x1874730541965312:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787882646.457156:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:10579:x1874730541965312:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 Request processed in 95829us (96095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882646.457174:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 124 00000004:00080000:2.0:1787882646.457370:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:2.0:1787882646.457402:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:2.0:1787882646.457433:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787882646.457467:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa2a02c7300 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787882646.457472:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2a91e8700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa290247c00 00000020:00080000:2.0:1787882646.457475:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2a91e8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa287a57c00 00000001:00080000:2.0:1787882646.457494:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1787882646.457506:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787882646.457514:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa2861a2c00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787882646.457516:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2bf44c700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa2861a2780 00000020:00080000:2.0:1787882646.457519:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2bf44cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa2c1612c00 00000004:00080000:2.0:1787882646.457527:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787882646.457747:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787882646.458031:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787882646.458055:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563996160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787882646.458142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882646.458227:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787882646.458233:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563996288:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787882646.458259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882646.458300:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563996160 00000100:00100000:2.0:1787882646.458309:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563996160 00000100:00100000:2.0:1787882646.458354:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563996288 00000100:00100000:2.0:1787882646.458356:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563996288 00000100:00100000:2.0:1787882646.458373:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787882646.458382:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa298adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1874730563996160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787882646.458437:0:6711:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1787882646.458474:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.458505:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5df411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843134 expref: 11 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.458516:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787882646.458521:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882646.458527:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.458559:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5df411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843134 expref: 11 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.458576:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5df411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843134 expref: 11 pid: 6709 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.458589:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6711:1874730563996416:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882646.458643:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa282b4a480 going to sleep for 11 seconds 00000100:00100000:2.0:1787882646.458660:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787882646.458668:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874730563996288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787882646.458836:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787882646.458840:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787882645 00002000:00010000:2.0:1787882646.458843:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787882646.458845:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787882645 -> 1787882645 00002000:00010000:2.0:1787882646.458853:0:6710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787882646.458929:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3305:x1874730563996288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 261us (668us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787882646.458936:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1787882646.459069:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2bf3fc700/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787882646.459076:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563996288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787882646.459359:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787882646.459373:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563996544:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787882646.459406:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882646.459932:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563996544 00000100:00100000:2.0:1787882646.459942:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563996544 00000100:00100000:2.0:1787882646.460051:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787882646.460061:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730563996544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787882646.460087:0:6710:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1787882646.460123:0:6710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a90ec94, atime: 0x6a90ec94, ctime: 0x6a90ec94, blocks: 0x1 00010000:00010000:2.0:1787882646.460132:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df656 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.460148:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1787882646.460152:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882646.460159:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.460178:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.460189:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.460198:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.460234:0:6710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787882646.460955:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882646.460967:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.460981:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882646.460987:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.460998:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df656 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.461019:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df656 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.461027:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f29c74eb/0xf4731e8a7c5df656 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.461068:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882646.461070:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882646.461072:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787882646.462959:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787882646.466278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882646.470352:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882646.470396:0:6709:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787882646.470408:0:6709:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1787882646.470538:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541965568 00000100:00100000:3.0:1787882646.470551:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541965568 00000100:00100000:3.0:1787882646.470721:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:3.0:1787882646.470735:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+12:2356:x1874730541965568:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787882646.471073:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541965440 00000100:00100000:1.0:1787882646.471080:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541965440 00010000:00010000:1.0:1787882646.471114:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5df411 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843134 expref: 13 pid: 6709 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882646.471150:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:1.0:1787882646.471160:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2357:x1874730541965440:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882646.471197:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882646.471204:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5df411 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843134 expref: 13 pid: 6709 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.471221:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5df411 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843134 expref: 13 pid: 6709 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.471266:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787882646.471271:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787882646.471277:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.471287:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.471309:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882646.471377:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2357:x1874730541965440:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 218us (5111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882646.471385:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00010000:00010000:0.0:1787882646.472543:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5df411 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843134 expref: 12 pid: 6709 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.472719:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1874730563996544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12656us (13307us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787882646.472731:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1787882646.472825:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2af7fb480/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787882646.472833:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563996544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787882646.473382:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6711:1874730563996416:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882646.473415:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.473629:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.473640:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.473920:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.473929:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.473954:0:6711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787882646.475711:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2bf3ff800/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787882646.475726:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563996160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787882646.476459:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa298adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1874730563996160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16269us (16509us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787882646.476478:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787882646.477779:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882646.477805:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.477822:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882646.477829:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.477842:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.477942:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.477953:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f35240e8/0xf4731e8a7c5df64f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.478005:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882646.478007:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882646.478009:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787882646.540734:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1787882646.540761:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787882646.541089:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1787882646.541517:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541965568:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 Request processed in 70775us (71170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882646.541532:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:0.0:1787882646.548727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882646.548973:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541965824 00000100:00100000:1.0:1787882646.548987:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541965824 00000100:00100000:1.0:1787882646.549096:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:1.0:1787882646.549110:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:10579:x1874730541965824:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787882646.549385:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882646.549423:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df63a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c7 expref: 15 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.549447:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:1.0:1787882646.549453:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787882646.549511:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df65d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.549530:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df65d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.549541:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df65d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787882646.550372:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000796ba6b5 reply state 0000000015ad9dbe transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df65d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882646.550388:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787882646.550641:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:10579:x1874730541965824:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 1531us (1925us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787882646.550652:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 125 00010000:00010000:3.0:1787882646.552113:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df65d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.552133:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df65d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.552141:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df65d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.552148:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882646.552154:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df65d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.552162:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df65d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.552183:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:3.0:1787882646.552187:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882646.552211:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df65d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.552218:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5df65d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.554470:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882646.555065:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541965952 00000100:00100000:3.0:1787882646.555079:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541965952 00000100:00100000:3.0:1787882646.555147:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:3.0:1787882646.555159:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2356:x1874730541965952:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787882646.555456:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787882646.555460:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787882645 -> 1787882644 00002000:00010000:3.0:1787882646.555463:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787882644 00002000:00010000:3.0:1787882646.555466:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787882645 -> 1787882644 00002000:00010000:3.0:1787882646.555469:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787882646.555548:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730541965952:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 390us (1091us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787882646.555557:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:0.0:1787882646.558554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.558687:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541966208 00000100:00100000:2.0:1787882646.558700:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541966208 00000100:00100000:2.0:1787882646.558781:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 126 00000100:00100000:2.0:1787882646.558805:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:10579:x1874730541966208:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787882646.559019:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.559047:0:6733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df61e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b9 expref: 15 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.559058:0:6733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.559104:0:6733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df61e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b9 expref: 15 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.559121:0:6733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df61e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b9 expref: 15 pid: 6733 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.559139:0:6733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730563996672:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882646.559268:0:6733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa285be4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787882646.562214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882646.562308:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541966336 00000100:00100000:3.0:1787882646.562321:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541966336 00010000:00010000:3.0:1787882646.562374:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df61e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b9 expref: 16 pid: 6733 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882646.562432:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:3.0:1787882646.562444:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:2357:x1874730541966336:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882646.562463:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882646.562471:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df61e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b9 expref: 16 pid: 6733 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.562511:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df61e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b9 expref: 16 pid: 6733 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.562539:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:3.0:1787882646.562545:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.562555:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.562563:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.562587:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882646.562663:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:2357:x1874730541966336:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 213us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882646.562673:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00010000:00010000:2.0:1787882646.563863:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df61e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431b9 expref: 15 pid: 6733 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.563966:0:6733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730563996672:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882646.564006:0:6733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.564018:0:6733:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.564025:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.564064:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.564072:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.564081:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.564087:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882646.564093:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.564101:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.564119:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:2.0:1787882646.564122:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787882646.564127:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.564140:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df664 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.564217:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:10579:x1874730541966208:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 Request processed in 5426us (5679us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787882646.564229:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 126 00000100:00100000:0.0:1787882646.569097:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.569213:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541966464 00000100:00100000:2.0:1787882646.569227:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541966464 00000100:00100000:2.0:1787882646.569304:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:2.0:1787882646.569316:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2358:x1874730541966464:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787882646.569378:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.569405:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.569415:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882646.569432:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882646.569438:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.569488:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 7 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.569504:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 7 pid: 6709 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.569549:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6710:1874730563996800:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882646.569838:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa285be4000 going to sleep for 11 seconds 00000100:00100000:0.0:1787882646.573553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882646.573701:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541966592 00000100:00100000:1.0:1787882646.573714:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541966592 00010000:00010000:1.0:1787882646.573767:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 8 pid: 6709 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882646.573837:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:1.0:1787882646.573849:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730541966592:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882646.573918:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882646.573951:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 8 pid: 6709 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.573967:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 8 pid: 6709 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.573998:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787882646.574003:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787882646.574010:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.574022:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.574059:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882646.574121:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730541966592:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 274us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882646.574129:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00010000:00010000:2.0:1787882646.575126:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058778443/0xf4731e8a7c5df648 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431d5 expref: 7 pid: 6709 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.575161:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6710:1874730563996800:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882646.575194:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.575206:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.575214:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.575255:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.575264:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.575273:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.575308:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882646.575313:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.575323:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.575341:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.575349:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6d32dc7/0xf4731e8a7c5df66b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.575590:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541966464:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 Request processed in 6275us (6508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882646.575600:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:3.0:1787882646.578752:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.578907:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541966848 00000100:00100000:2.0:1787882646.578920:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541966848 00000100:00100000:2.0:1787882646.578993:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 127 00000100:00100000:2.0:1787882646.579006:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:10579:x1874730541966848:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787882646.579116:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df672 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.579138:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.579171:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.579440:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.579453:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df62c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c0 expref: 15 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.579462:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.579507:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df62c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c0 expref: 15 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.579524:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df62c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c0 expref: 15 pid: 6733 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882646.579542:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730563996928:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882646.579662:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa285be4000 going to sleep for 11 seconds 00000100:00100000:2.0:1787882646.582630:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730563996928:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882646.582684:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882646.588633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882646.588856:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541966976 00000100:00100000:2.0:1787882646.588980:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541966976 00010000:00010000:3.0:1787882646.589124:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df62c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c0 expref: 16 pid: 6733 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882646.589225:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:3.0:1787882646.589238:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:2356:x1874730541966976:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882646.589258:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882646.589267:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df62c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c0 expref: 16 pid: 6733 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.589310:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df62c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c0 expref: 16 pid: 6733 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.589337:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df62c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431c0 expref: 16 pid: 6733 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.589359:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:3.0:1787882646.589365:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.589376:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.589385:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.589420:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882646.589495:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:2356:x1874730541966976:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 258us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882646.589504:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00010000:00010000:2.0:1787882646.589738:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882646.589760:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882646.590042:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787882646.590235:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787882646.590289:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787882646.590395:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874730563997056:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787882646.590464:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882646.590512:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa285be4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787882646.590673:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563997056 00000100:00100000:0.0:1787882646.590682:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563997056 00000100:00100000:0.0:1787882646.590734:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787882646.590744:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1874730563997056:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787882646.590850:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1874730563997056:12345-0@lo:1000:mdt00_001.0 Request processed in 107us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882646.590858:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787882646.590932:0:5844:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787882646.590940:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1787882646.590963:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2bf3fc700, transno 4294967309 00000100:00100000:0.0:1787882646.590980:0:5844:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fa2bf3ff800 x1874730563996160/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787882662 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882646.590995:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874730563997056:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787882646.591547:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787882646.591625:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874730563997184:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787882646.591677:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882646.591717:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563997184 00000100:00100000:0.0:1787882646.591723:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563997184 00000100:00100000:0.0:1787882646.591752:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787882646.591760:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1874730563997184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787882646.591987:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1874730563997184:12345-0@lo:1000:mdt00_001.0 Request processed in 227us (309us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787882646.591996:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787882646.592222:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b94796c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882646.592251:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874730563997184:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787882646.592291:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592311:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592319:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592326:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882646.592331:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592338:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592357:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:0.0:1787882646.592360:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787882646.592365:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592371:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df679 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592417:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592422:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592428:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592433:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882646.592442:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592450:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592458:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:0.0:1787882646.592461:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787882646.592469:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031600/0xf4731e8a7c5df5c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431a4 expref: 18 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592480:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031600/0xf4731e8a7c5df5c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431a4 expref: 18 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592489:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031600/0xf4731e8a7c5df5c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431a4 expref: 18 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.592522:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031600/0xf4731e8a7c5df5c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431a4 expref: 18 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882646.592536:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730563997312:192.168.206.21@tcp:105: 00000100:00100000:0.0:1787882646.592632:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b94796c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882646.597618:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882646.597706:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541967104 00000100:00100000:1.0:1787882646.597718:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541967104 00000100:00100000:1.0:1787882646.597787:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:1.0:1787882646.597809:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10578:x1874730541967104:12345-192.168.206.21@tcp:49:lfs.0 00000100:00100000:1.0:1787882646.598021:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:10578:x1874730541967104:12345-192.168.206.21@tcp:49:lfs.0 Request processed in 214us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882646.598030:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:0.0:1787882646.602295:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730563997312:192.168.206.21@tcp:105: 00010000:00010000:0.0:1787882646.602344:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.602359:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df5bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602547:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df680 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602579:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df680 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602594:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df680 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602608:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df680 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602615:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df680 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602623:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df680 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602641:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882646.602646:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df680 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602663:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df680 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602680:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:1.0:1787882646.602684:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882646.602688:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df680 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602694:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df680 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602708:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602715:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df672 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602721:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df672 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602726:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882646.602729:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df672 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602735:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df672 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602754:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:1.0:1787882646.602756:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787882646.602760:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df672 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.602766:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df672 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882646.603170:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10579:x1874730541966848:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 24162us (24427us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787882646.603184:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 127 00000020:00080000:1.0:1787882646.603192:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787882646.604206:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882646.604216:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882646.604745:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787882646.604758:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787882646.606021:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882646.606123:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541967360 00000100:00100000:1.0:1787882646.606138:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541967360 00000100:00100000:1.0:1787882646.606215:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:1.0:1787882646.606230:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10578:x1874730541967360:12345-192.168.206.21@tcp:58:lfs.0 00000040:00080000:1.0:1787882646.606751:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787882646.606901:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10578:x1874730541967360:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 673us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882646.606910:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:3.0:1787882646.609094:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882646.613463:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541967616 00000100:00100000:1.0:1787882646.613484:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541967616 00000100:00100000:1.0:1787882646.613592:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:1.0:1787882646.613606:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa288322450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:10579:x1874730541967616:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787882646.615126:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787882646.615290:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787882646.615378:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df687 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.615408:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df687 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.615425:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df687 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.615436:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df687 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.615469:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df687 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.615476:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df687 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.616585:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787882646.616918:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa288322450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:10579:x1874730541967616:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 3307us (7831us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787882646.616932:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00000020:00080000:1.0:1787882646.616940:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787882646.620893:0:11677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882646.620914:0:11677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df687 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.620929:0:11677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882646.620934:0:11677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df687 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.620973:0:11677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df687 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.620997:0:11677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fa283291a00) 00010000:00010000:3.0:1787882646.621001:0:11677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787882646.621007:0:11677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df687 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.621014:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df687 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882646.621044:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882646.621046:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882646.621048:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882646.634443:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882646.641426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882646.641639:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541967744 00000100:00100000:1.0:1787882646.641653:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541967744 00000100:00100000:1.0:1787882646.641805:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 129 00000100:00100000:1.0:1787882646.641817:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:10581:x1874730541967744:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1787882646.641849:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882646.642023:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df68e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431dc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.642234:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df695 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.642274:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.642288:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.642306:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5df69c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.642314:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5df69c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.642320:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5df69c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.643265:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.643287:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84319d expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.643298:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.643350:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84319d expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.643372:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84319d expref: 21 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882646.643406:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563997440:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882646.643744:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa281254540 going to sleep for 11 seconds 00000100:00100000:1.0:1787882646.647095:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730563997440:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882646.647138:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882646.647972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882646.648214:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541968000 00000100:00100000:3.0:1787882646.648225:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541968000 00000100:00100000:3.0:1787882646.648300:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:3.0:1787882646.648313:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:5609:x1874730541968000:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787882646.648843:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:5609:x1874730541968000:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 531us (873us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787882646.648852:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:0.0:1787882646.652482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882646.652602:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541968128 00000100:00100000:1.0:1787882646.652616:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541968128 00010000:00010000:1.0:1787882646.652680:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84319d expref: 23 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882646.652727:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:1.0:1787882646.652739:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:2356:x1874730541968128:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882646.652756:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882646.652765:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84319d expref: 23 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.652780:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84319d expref: 23 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.652818:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5df5ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84319d expref: 23 pid: 5843 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.652841:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:1.0:1787882646.652847:0:8466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.652938:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.652947:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882646.652977:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882646.653044:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:2356:x1874730541968128:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 306us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882646.653053:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 59 00010000:00010000:0.0:1787882646.653293:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653303:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882646.653362:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787882646.653368:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882646.653394:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653410:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653421:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653429:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df695 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653436:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653454:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882646.653459:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653468:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df695 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653480:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:0.0:1787882646.653483:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882646.653488:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df695 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653494:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df695 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653509:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5df69c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653515:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5df69c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653520:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5df69c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653525:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882646.653527:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5df69c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653533:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5df69c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653552:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fa283291500) 00010000:00010000:0.0:1787882646.653555:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882646.653558:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5df69c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653564:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5df69c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653604:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5df68e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431dc expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653620:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431dc expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882646.653627:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:0.0:1787882646.653630:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882646.653632:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6a00, rc 0) 00000100:00100000:0.0:1787882646.653698:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:10581:x1874730541967744:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 11883us (12286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882646.653706:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 129 00000100:00100000:0.0:1787882647.205401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882647.205456:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882647.205486:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882647.205513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882647.205545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882647.205578:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541968512 00000100:00100000:0.0:1787882647.205591:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541968512 00000100:00100000:0.0:1787882647.205671:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541968640 00000100:00100000:0.0:1787882647.205675:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541968640 00000100:00100000:0.0:1787882647.205697:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:0.0:1787882647.205708:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2359:x1874730541968512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882647.205805:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2359:x1874730541968512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 99us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882647.205814:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:0.0:1787882647.205850:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:0.0:1787882647.205856:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541968640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882647.205904:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541968640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 48us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882647.205909:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:0.0:1787882647.205930:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541968768 00000100:00100000:0.0:1787882647.205933:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541968768 00000100:00100000:0.0:1787882647.205959:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541968384 00000100:00100000:0.0:1787882647.205962:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541968384 00000100:00100000:0.0:1787882647.205978:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 139 00000100:00100000:0.0:1787882647.205983:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2359:x1874730541968768:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882647.206011:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2359:x1874730541968768:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882647.206017:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 139 00000100:00100000:0.0:1787882647.206029:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 140 00000100:00100000:0.0:1787882647.206033:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:2359:x1874730541968384:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882647.206055:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:2359:x1874730541968384:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 22us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882647.206070:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 140 00000100:00080000:0.0:1787882647.206095:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787882647.206100:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787882647.206473:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541968256 00000100:00100000:3.0:1787882647.206478:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541968256 00000100:00100000:3.0:1787882647.206522:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 289 00000100:00100000:3.0:1787882647.206529:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541968256:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882647.206570:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541968256:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 41us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882647.206587:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 289 00000040:00080000:3.0:1787882647.580105:0:12118:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787882647.580116:0:12118:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787882647.581114:0:12118:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787882647.581123:0:12118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787882647.658332:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787882647.659101:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882647.659109:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882647.659159:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787882647.659168:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787882647.659332:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730563997568:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787882647.659524:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2860549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882647.677666:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882647.677728:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730563997568:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787882647.677972:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541968896 00000100:00100000:0.0:1787882647.677980:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541968896 00000100:00100000:0.0:1787882647.678041:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:0.0:1787882647.678053:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:10593:x1874730541968896:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787882647.678094:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787882647.678216:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:10593:x1874730541968896:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 164us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882647.678225:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:0.0:1787882647.682123:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882647.682197:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541969152 00000100:00100000:0.0:1787882647.682209:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541969152 00000100:00100000:0.0:1787882647.682310:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00100000:0.0:1787882647.682484:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:10593:x1874730541969152:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882647.682518:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882647.682575:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431e3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.682755:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df6b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.682781:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.682810:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882647.682825:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787882647.683142:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431e3 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.683171:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431e3 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.683182:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:0.0:1787882647.683186:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882647.683190:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8c00, rc 0) 00000100:00100000:0.0:1787882647.683265:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:10593:x1874730541969152:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 787us (1155us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787882647.683276:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00100000:0.0:1787882647.685543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882647.685619:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541969280 00000100:00100000:3.0:1787882647.685630:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541969280 00000100:00100000:3.0:1787882647.685702:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:3.0:1787882647.685714:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d853850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:2356:x1874730541969280:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882647.685730:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882647.685756:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df6b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431e3 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882647.685774:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:3.0:1787882647.685779:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882647.685849:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d853850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:2356:x1874730541969280:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 137us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882647.685857:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:0.0:1787882647.692425:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882647.692474:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541969536 00000100:00100000:0.0:1787882647.692485:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541969536 00000100:00100000:0.0:1787882647.692548:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 132 00000100:00100000:0.0:1787882647.692590:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:10593:x1874730541969536:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787882647.692690:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.692710:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.692722:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.693011:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.693019:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.693027:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.693033:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882647.693038:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.693046:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.693061:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:0.0:1787882647.693065:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787882647.693070:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882647.693076:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df6bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882647.693257:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:10593:x1874730541969536:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 667us (850us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787882647.693266:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 132 00000040:00080000:0.0:1787882647.693419:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882647.693424:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882647.693988:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787882647.693998:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787882647.700924:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882647.701017:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541969792 00000100:00100000:1.0:1787882647.701030:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541969792 00000100:00100000:1.0:1787882647.701096:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:1.0:1787882647.701109:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:10593:x1874730541969792:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787882647.701443:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:10593:x1874730541969792:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 334us (579us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787882647.701452:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 34 00010000:00010000:2.0:1787882648.682919:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787882648.970391:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787882648.970416:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:3.0:1787882649.401043:0:12172:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787882649.401052:0:12172:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787882649.401846:0:12172:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787882649.401854:0:12172:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787882649.537723:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882649.538133:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541970048 00000100:00100000:2.0:1787882649.538143:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541970048 00000100:00100000:2.0:1787882649.538213:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 133 00000100:00100000:2.0:1787882649.538225:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:10613:x1874730541970048:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882649.538249:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882649.538268:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df6c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431ea expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882649.538364:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df6cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882649.538378:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df6cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882649.538391:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df6cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882649.538415:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787882649.538541:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5df6c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ea expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882649.538558:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df6cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ea expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882649.538786:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:2.0:1787882649.538793:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787882649.538797:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264400, rc 0) 00000100:00100000:2.0:1787882649.538858:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:10613:x1874730541970048:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 635us (1142us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787882649.538865:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 133 00000100:00080000:3.0:1787882649.539718:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882649.542432:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882649.542512:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541970176 00000100:00100000:1.0:1787882649.542523:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541970176 00000100:00100000:1.0:1787882649.542583:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 134 00000100:00100000:1.0:1787882649.542593:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:10613:x1874730541970176:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:1.0:1787882649.542669:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df6db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882649.542686:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882649.542707:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882649.542743:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df6db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882649.542750:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df6db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882649.542767:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df6db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882649.542782:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882649.542787:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df6db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882649.542795:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df6db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882649.542807:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:1.0:1787882649.542810:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787882649.542814:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df6db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882649.542820:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5df6db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882649.542912:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:10613:x1874730541970176:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 320us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882649.542919:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 134 00000100:00100000:1.0:1787882649.644759:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882649.644864:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541970304 00000100:00100000:2.0:1787882649.644909:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541970304 00000100:00100000:2.0:1787882649.644970:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:2.0:1787882649.644979:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541970304:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:2.0:1787882649.644996:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882649.645016:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5df6e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431f1 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882649.645040:0:6710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a90ec94, atime: 0x6a90ec94, ctime: 0x6a90ec94, blocks: 0xb 00010000:00010000:2.0:1787882649.645058:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1787882649.645063:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882649.645072:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5df6e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f1 expref: 7 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882649.645108:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5df6e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f1 expref: 7 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882649.645122:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265000, rc 0) 00000100:00100000:2.0:1787882649.645178:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2358:x1874730541970304:12345-192.168.206.21@tcp:101:cat.0 Request processed in 200us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882649.645185:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00080000:3.0:1787882649.645295:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882649.651215:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882649.651505:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541970432 00000100:00100000:2.0:1787882649.651522:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541970432 00002000:00100000:2.0:1787882649.651586:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9fa2b6169f80 x1874730541970432/t0(0) o3->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:380/0 lens 488/0 e 0 to 0 dl 1787882660 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787882649.651599:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2b6169f80 with x1874730541970432 ext(0->4095) 00002000:00010000:2.0:1787882649.651605:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2b6169f80 00000100:00100000:2.0:1787882649.651705:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:2.0:1787882649.651717:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541970432:12345-192.168.206.21@tcp:3:cat.0 00000100:00100000:2.0:1787882649.652025:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541970432:12345-192.168.206.21@tcp:3:cat.0 Request processed in 310us (823us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787882649.652033:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00002000:00100000:2.0:1787882649.652041:0:6716:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9fa2b6169f80 x1874730541970432/t0(0) o3->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:380/0 lens 488/4536 e 0 to 0 dl 1787882660 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787882649.652049:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2b6169f80 with x1874730541970432 ext(0->4095) 00002000:00010000:2.0:1787882649.652053:0:6716:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2b6169f80 00010000:00010000:3.0:1787882649.707811:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882650.731301:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882650.927491:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563997696:0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.927636:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882650.927685:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730563998208:0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.927714:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882650.927738:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787882650.927743:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563998080:0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.927778:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882650.927813:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563997824:0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.927837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882650.927853:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563998336:0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.927892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882650.927910:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787882650.927915:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563997952:0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.927936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882650.927968:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563997696 00000100:00100000:2.0:1787882650.927975:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563997696 00000100:00100000:2.0:1787882650.928017:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787882650.928027:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563997696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.928072:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563997696:12345-0@lo:400:kworker.0 Request processed in 46us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882650.928079:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787882650.928120:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563998208 00000100:00100000:2.0:1787882650.928124:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563998208 00000100:00100000:2.0:1787882650.928158:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563997824 00000100:00100000:2.0:1787882650.928161:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563997824 00000100:00100000:2.0:1787882650.928172:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563997952 00000100:00100000:2.0:1787882650.928174:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563997952 00000100:00100000:2.0:1787882650.928204:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787882650.928210:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730563998208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.928241:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730563998208:12345-0@lo:400:kworker.0 Request processed in 31us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882650.928247:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787882650.928261:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787882650.928267:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563997824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.928298:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730563997824:12345-0@lo:400:kworker.0 Request processed in 32us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882650.928303:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787882650.928317:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787882650.928323:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563997952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.928348:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730563997952:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882650.928354:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787882650.928390:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563997696:0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.928403:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730563998208:0@lo:400:kworker.0 00000100:00080000:2.0:1787882650.928424:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882650.928441:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730563997952:0@lo:400:kworker.0 00000100:00100000:2.0:1787882650.928451:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730563997824:0@lo:400:kworker.0 00000100:00100000:0.0:1787882650.929644:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563998080 00000100:00100000:0.0:1787882650.929652:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563998080 00000100:00100000:0.0:1787882650.929703:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563998336 00000100:00100000:0.0:1787882650.929706:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563998336 00000100:00100000:0.0:1787882650.929728:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787882650.929735:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563998080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882650.929812:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563998080:12345-0@lo:400:kworker.0 Request processed in 77us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882650.929819:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787882650.929843:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787882650.929849:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1874730563998336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882650.929898:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1874730563998336:12345-0@lo:400:kworker.0 Request processed in 50us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882650.929904:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787882650.929950:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787882650.929956:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787882650.929973:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2af7fb480, transno 4294967304 00000100:00100000:0.0:1787882650.929996:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563998080:0@lo:400:kworker.0 00000100:00080000:1.0:1787882650.931720:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882650.931727:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882650.932434:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563998464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882650.932497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882650.932590:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563998336:0@lo:400:kworker.0 00000100:00100000:1.0:1787882650.933660:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563998464 00000100:00100000:1.0:1787882650.933669:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563998464 00000100:00100000:1.0:1787882650.933713:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787882650.933724:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563998464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882650.933757:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882650.933882:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563998464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882650.933889:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787882650.933934:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563998464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787882651.437363:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563998592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787882651.437439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882651.437528:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563998592 00000100:00100000:1.0:1787882651.437535:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563998592 00000100:00100000:1.0:1787882651.437578:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787882651.437587:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874730563998592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882651.437619:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882651.437664:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874730563998592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882651.437671:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787882651.437725:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730563998592:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1787882651.510334:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:2.0:1787882651.510353:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa2b9479e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787882651.510359:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2bf41e600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa2b9479300 00000020:00080000:2.0:1787882651.510362:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2bf41ef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa298c29000 00000001:00080000:2.0:1787882651.510385:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:2.0:1787882651.510401:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787882651.510414:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1787882651.510459:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787882651.510678:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1787882651.754175:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787882651.991269:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1787882651.991290:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:1.0:1787882652.321844:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882652.321941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882652.321980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882652.322007:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882652.322036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882652.322060:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541971072 00000100:00100000:1.0:1787882652.322060:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541970688 00000100:00100000:3.0:1787882652.322075:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541971072 00000100:00100000:1.0:1787882652.322082:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541970688 00000100:00100000:1.0:1787882652.322160:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 144 00000100:00100000:0.0:1787882652.322228:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541970560 00000100:00100000:0.0:1787882652.322232:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541970560 00000100:00100000:0.0:1787882652.322264:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 291 00000100:00100000:0.0:1787882652.322272:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541970560:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882652.322362:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2359:x1874730541970560:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 90us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882652.322370:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 291 00000100:00100000:0.0:1787882652.322425:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541970816 00000100:00100000:0.0:1787882652.322428:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541970816 00000100:00100000:0.0:1787882652.322455:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541970944 00000100:00100000:0.0:1787882652.322458:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541970944 00000100:00100000:0.0:1787882652.322477:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:0.0:1787882652.322485:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2359:x1874730541970816:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882652.322514:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2359:x1874730541970816:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882652.322520:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:0.0:1787882652.322533:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:0.0:1787882652.322539:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541970944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882652.322563:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2359:x1874730541970944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882652.322570:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00080000:0.0:1787882652.323141:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787882652.323157:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787882652.323161:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882652.328946:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00100000:2.0:1787882652.328967:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2359:x1874730541971072:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882652.329084:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2359:x1874730541971072:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 124us (7102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882652.329093:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00100000:1.0:1787882652.335265:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2359:x1874730541970688:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882652.335444:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2359:x1874730541970688:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 13273us (13434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882652.335458:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 144 00010000:00010000:2.0:1787882652.779361:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882653.741981:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882653.742153:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541971200 00000100:00100000:0.0:1787882653.742165:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541971200 00000100:00100000:0.0:1787882653.742237:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 135 00000100:00100000:0.0:1787882653.742249:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:10258:x1874730541971200:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787882653.742389:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:10258:x1874730541971200:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 Request processed in 141us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882653.742404:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 135 00000100:00100000:0.0:1787882653.747628:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882653.748686:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541971456 00000100:00100000:1.0:1787882653.748702:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541971456 00000100:00100000:1.0:1787882653.748800:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:1.0:1787882653.748812:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:10258:x1874730541971456:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787882653.750022:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:10258:x1874730541971456:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 1203us (2401us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787882653.750034:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 35 00010000:00010000:3.0:1787882653.802270:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787882653.868127:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787882653.868141:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787882653.868504:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787882653.868511:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787882654.044394:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882654.044948:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541971584 00000100:00100000:1.0:1787882654.044971:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541971584 00000100:00100000:1.0:1787882654.045119:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 136 00000100:00100000:1.0:1787882654.045133:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:11068:x1874730541971584:12345-192.168.206.21@tcp:101:lsof.0 00010000:00010000:1.0:1787882654.045168:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882654.045195:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df6e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431f8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882654.045282:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882654.045299:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882654.045318:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882654.045607:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787882654.045613:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787882654.045725:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882654.045769:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5df6e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f8 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882654.045797:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f8 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882654.045807:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:1.0:1787882654.045811:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787882654.045815:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa7400, rc 0) 00000100:00100000:1.0:1787882654.045971:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:11068:x1874730541971584:12345-192.168.206.21@tcp:101:lsof.0 Request processed in 841us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882654.045980:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 136 00000100:00080000:0.0:1787882654.046800:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787882654.827061:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882655.859734:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882656.042335:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563998976:0@lo:400:kworker.0 00000100:00100000:3.0:1787882656.042438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882656.042526:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787882656.042533:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b6168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563998848:0@lo:400:kworker.0 00000100:00100000:3.0:1787882656.042558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882656.042575:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bfaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563999360:0@lo:400:kworker.0 00000100:00100000:3.0:1787882656.042600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882656.042762:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563998976 00000100:00100000:2.0:1787882656.042781:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563998976 00000100:00100000:2.0:1787882656.042854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563998848 00000100:00100000:2.0:1787882656.042898:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563998848 00000100:00100000:2.0:1787882656.042928:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787882656.042938:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563998976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882656.043015:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730563998976:12345-0@lo:400:kworker.0 Request processed in 77us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882656.043023:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787882656.043061:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787882656.043069:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563998848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882656.043080:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563998720:0@lo:400:kworker.0 00000100:00100000:2.0:1787882656.043104:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730563998848:12345-0@lo:400:kworker.0 Request processed in 35us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882656.043114:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787882656.043174:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b6168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730563998848:0@lo:400:kworker.0 00000100:00100000:1.0:1787882656.043187:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882656.043198:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730563998976:0@lo:400:kworker.0 00000100:00100000:2.0:1787882656.043245:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563998720 00000100:00100000:2.0:1787882656.043250:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563998720 00000100:00100000:1.0:1787882656.043279:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bfaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730563999232:0@lo:400:kworker.0 00000100:00100000:2.0:1787882656.043288:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787882656.043300:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563998720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882656.043332:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882656.043353:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d807450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730563998720:12345-0@lo:400:kworker.0 Request processed in 54us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882656.043363:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787882656.043394:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730563998720:0@lo:400:kworker.0 00000100:00100000:1.0:1787882656.043416:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787882656.043419:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563999232 00000100:00100000:2.0:1787882656.043425:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563999232 00000100:00100000:1.0:1787882656.043428:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b6168a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563999104:0@lo:400:kworker.0 00000100:00100000:2.0:1787882656.043463:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787882656.043473:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730563999232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882656.043486:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882656.043531:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730563999232:12345-0@lo:400:kworker.0 Request processed in 59us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882656.043549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787882656.043557:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bfaf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730563999232:0@lo:400:kworker.0 00000100:00080000:3.0:1787882656.043658:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882656.043888:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563999360 00000100:00100000:0.0:1787882656.043894:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563999360 00000100:00100000:0.0:1787882656.043933:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563999104 00000100:00100000:0.0:1787882656.043936:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563999104 00000100:00100000:0.0:1787882656.043959:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787882656.043966:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563999360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882656.044023:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730563999360:12345-0@lo:400:kworker.0 Request processed in 58us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882656.044030:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787882656.044059:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787882656.044066:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563999104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882656.046106:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787882656.046151:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563999488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882656.046237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882656.046322:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563999488 00000100:00100000:1.0:1787882656.046337:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563999488 00000100:00100000:2.0:1787882656.046343:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787882656.046352:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2bf3ff800, transno 4294967310 00000004:00080000:2.0:1787882656.046371:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787882656.046408:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787882656.046419:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874730563999488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882656.046459:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882656.046535:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874730563999488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882656.046542:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787882656.046946:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bfaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730563999360:0@lo:400:kworker.0 00000100:00080000:3.0:1787882656.047037:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787882656.047045:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882656.047102:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730563999488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882656.050685:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563999104:12345-0@lo:400:kworker.0 Request processed in 6605us (7185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882656.050705:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787882656.051728:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b6168a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563999104:0@lo:400:kworker.0 00000100:00100000:3.0:1787882656.554185:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787882656.554206:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563999616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882656.554270:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882656.554333:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730563999616 00000100:00100000:3.0:1787882656.554340:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730563999616 00000100:00100000:3.0:1787882656.554384:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787882656.554393:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563999616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787882656.554424:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882656.554466:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730563999616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882656.554473:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787882656.554540:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730563999616:0@lo:13:osp-pre-1-0.0 00000020:00080000:3.0:1787882656.606161:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1787882656.606200:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787882656.606355:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787882656.606365:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787882656.879807:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787882657.285268:0:12373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:04:15 (1787882655) 00000100:00100000:1.0:1787882657.444717:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882657.444774:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882657.444780:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541971712 00000100:00100000:0.0:1787882657.444789:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541971712 00000100:00100000:1.0:1787882657.444804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882657.444832:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882657.444850:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 293 00000100:00100000:1.0:1787882657.444857:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882657.444859:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2358:x1874730541971712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882657.444891:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541972224 00000100:00100000:1.0:1787882657.444895:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541972224 00000100:00100000:1.0:1787882657.444930:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541971840 00000100:00100000:1.0:1787882657.444932:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541971840 00000100:00100000:0.0:1787882657.444938:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2358:x1874730541971712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882657.444946:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 293 00000100:00100000:1.0:1787882657.444950:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 149 00000100:00100000:1.0:1787882657.444956:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:2358:x1874730541972224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882657.444984:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:2358:x1874730541972224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882657.444990:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 149 00000100:00100000:1.0:1787882657.445004:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 150 00000100:00100000:1.0:1787882657.445020:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2358:x1874730541971840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882657.445048:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2358:x1874730541971840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882657.445054:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 150 00000100:00100000:1.0:1787882657.445074:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541971968 00000100:00100000:1.0:1787882657.445078:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541971968 00000100:00100000:1.0:1787882657.445106:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541972096 00000100:00100000:1.0:1787882657.445109:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541972096 00000100:00100000:1.0:1787882657.445181:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:1.0:1787882657.445189:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541971968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882657.445216:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541971968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882657.445222:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:1.0:1787882657.445235:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:1.0:1787882657.445241:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541972096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882657.445263:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541972096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 22us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882657.445269:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00080000:0.0:1787882657.454092:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787882657.454102:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787882657.454106:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787882657.900185:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882658.669648:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882658.669825:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541972480 00000100:00100000:2.0:1787882658.669838:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541972480 00000100:00100000:2.0:1787882658.669963:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 137 00000100:00100000:2.0:1787882658.669977:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:11333:x1874730541972480:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882658.670004:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882658.670034:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df6f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8431ff expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.670155:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df6fe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.670173:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df6fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.670186:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df6fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.670229:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df705 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.670238:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df705 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.670244:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df705 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.670926:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df70c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.670942:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df70c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.670950:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df70c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882658.670963:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787882658.671191:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df6fe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671200:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df6fe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671208:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df6fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671214:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882658.671219:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df6fe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671237:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df6fe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671252:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa285a00b00) 00010000:00010000:2.0:1787882658.671256:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882658.671262:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df6fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671267:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df6fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671283:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df705 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671289:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df705 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671295:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df705 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671300:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882658.671302:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df705 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671308:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df705 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671314:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fa285a00000) 00010000:00010000:2.0:1787882658.671316:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882658.671319:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df705 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671335:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df705 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671851:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df6f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ff expref: 16 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671924:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df70c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ff expref: 15 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882658.671934:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:2.0:1787882658.671936:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882658.671939:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265600, rc 0) 00000100:00100000:2.0:1787882658.672032:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:11333:x1874730541972480:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 2056us (2398us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787882658.672043:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 137 00000100:00100000:3.0:1787882658.678294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882658.678374:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882658.678630:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541972736 00000100:00100000:1.0:1787882658.678645:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541972736 00000100:00100000:1.0:1787882658.678746:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:1.0:1787882658.678758:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:2357:x1874730541972736:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882658.678779:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882658.678812:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df70c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ff expref: 15 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882658.678845:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:1.0:1787882658.678850:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882658.679038:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1524a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:2357:x1874730541972736:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 280us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882658.679047:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:0.0:1787882658.679073:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541972608 00000100:00100000:0.0:1787882658.679087:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541972608 00000100:00100000:0.0:1787882658.679150:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 138 00000100:00100000:0.0:1787882658.679161:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:11333:x1874730541972608:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787882658.679269:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:11333:x1874730541972608:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 Request processed in 109us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882658.679277:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 138 00010000:00010000:2.0:1787882658.923005:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787882658.987153:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882658.987162:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882658.987195:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1787882658.987202:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787882659.947268:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882660.660393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882660.669076:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541972864 00000100:00100000:2.0:1787882660.669088:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541972864 00000100:00100000:2.0:1787882660.669159:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 139 00000100:00100000:2.0:1787882660.669169:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:11375:x1874730541972864:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882660.669188:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882660.669208:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df71a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843206 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669270:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df721 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669299:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df721 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669310:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df721 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669326:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df728 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669333:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669339:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669582:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df721 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669590:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df721 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669596:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df721 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669602:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882660.669607:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df721 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669615:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df721 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669634:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:2.0:1787882660.669643:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882660.669648:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df721 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669655:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669667:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df728 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669672:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df728 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669677:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df728 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669682:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882660.669685:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df728 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669691:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df728 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669698:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fa285a00600) 00010000:00010000:2.0:1787882660.669700:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882660.669703:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df728 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669708:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df728 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669750:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df71a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843206 expref: 15 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669772:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:2.0:1787882660.669775:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882660.669779:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df71a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843206 expref: 15 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.669789:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265600, rc 0) 00000100:00100000:2.0:1787882660.669854:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:11375:x1874730541972864:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 686us (9470us total) trans 0 rc 301/301 00000100:00100000:2.0:1787882660.669862:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 139 00000100:00080000:2.0:1787882660.669920:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882660.685295:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882660.687055:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541973120 00000100:00100000:0.0:1787882660.687069:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541973120 00000100:00100000:0.0:1787882660.687144:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 140 00000100:00100000:0.0:1787882660.687155:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:11375:x1874730541973120:12345-192.168.206.21@tcp:36:lfs.0 00010000:00010000:0.0:1787882660.687212:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882660.687239:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5df098 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84303f expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.687272:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:0.0:1787882660.687277:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787882660.687563:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.687579:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f8 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.687590:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.687633:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f8 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.687652:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f8 expref: 5 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882660.687665:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730563999744:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882660.687769:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479240 going to sleep for 11 seconds 00000100:00100000:0.0:1787882660.693027:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730563999744:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882660.693055:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882660.699075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882660.700345:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541973248 00000100:00100000:0.0:1787882660.700362:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541973248 00010000:00010000:0.0:1787882660.700432:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f8 expref: 6 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882660.700497:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:0.0:1787882660.700508:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:2356:x1874730541973248:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882660.700521:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882660.700528:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f8 expref: 6 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.700541:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f8 expref: 6 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.700561:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5df6f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f8 expref: 6 pid: 5843 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.700576:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:0.0:1787882660.700580:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.700588:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.700595:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.700622:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882660.700679:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2356:x1874730541973248:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 173us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882660.700686:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 60 00010000:00010000:0.0:1787882660.700732:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.700745:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.700764:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df736 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.700772:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df736 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.700779:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df736 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882660.702017:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787882660.702030:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.702039:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.702045:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.702052:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882660.702056:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.702063:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.702076:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa2a0727900) 00010000:00010000:0.0:1787882660.702079:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882660.702091:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.702097:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df72f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787882660.702115:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4370047 reply state 000000004892cacb transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df736 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882660.702122:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787882660.702196:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:11375:x1874730541973120:12345-192.168.206.21@tcp:36:lfs.0 Request processed in 15040us (16908us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787882660.702204:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 140 00000100:00080000:2.0:1787882660.702616:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787882660.713253:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df736 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.713273:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df736 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.713281:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df736 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.713287:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882660.713292:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df736 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.713300:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df736 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.713318:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fa289160b00) 00010000:00010000:0.0:1787882660.713321:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882660.713327:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df736 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.713347:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df736 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882660.794661:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882660.795915:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541973376 00000100:00100000:2.0:1787882660.795927:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541973376 00000100:00100000:2.0:1787882660.795992:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 141 00000100:00100000:2.0:1787882660.796003:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+14:11383:x1874730541973376:12345-192.168.206.21@tcp:101:lctl.0 00010000:00010000:2.0:1787882660.796027:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882660.796050:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df73d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84320d expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.796111:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df744 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.796125:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.796136:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882660.796214:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787882660.796217:0:6733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882660.796245:0:6733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.796270:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df73d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84320d expref: 16 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.796289:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84320d expref: 15 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.796297:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00600) 00010000:00010000:2.0:1787882660.796301:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787882660.796304:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264e00, rc 0) 00000100:00100000:2.0:1787882660.796388:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:11383:x1874730541973376:12345-192.168.206.21@tcp:101:lctl.0 Request processed in 372us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882660.796395:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 141 00000100:00100000:3.0:1787882660.876525:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882660.876759:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541973504 00000100:00100000:0.0:1787882660.876770:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541973504 00000100:00100000:0.0:1787882660.876975:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 142 00000100:00100000:0.0:1787882660.876988:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+15:11389:x1874730541973504:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1787882660.877010:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882660.877030:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df74b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843214 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877097:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df752 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877112:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877126:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877140:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df759 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877148:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877155:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877267:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877290:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877298:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882660.877332:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787882660.877337:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882660.877359:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877372:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877379:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df752 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877385:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877391:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882660.877396:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877403:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df752 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877414:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00600) 00010000:00010000:0.0:1787882660.877418:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882660.877422:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877441:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5df752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877455:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877461:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df759 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877467:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877472:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882660.877475:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877481:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df759 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877507:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fa289160b00) 00010000:00010000:0.0:1787882660.877510:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882660.877513:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df759 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877519:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df759 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877561:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df74b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843214 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877574:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843214 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882660.877601:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:0.0:1787882660.877604:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787882660.877606:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9c00, rc 0) 00000100:00100000:0.0:1787882660.877663:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:11389:x1874730541973504:12345-192.168.206.21@tcp:101:bash.0 Request processed in 677us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882660.877670:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 142 00000100:00100000:0.0:1787882660.889180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882660.889364:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541973760 00000100:00100000:2.0:1787882660.889384:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541973760 00000100:00100000:2.0:1787882660.889440:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 143 00000100:00100000:2.0:1787882660.889451:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+16:11389:x1874730541973760:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1787882660.889469:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882660.889488:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df767 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84321b expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.889635:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df76e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.889676:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df76e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.889687:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df76e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.889731:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df775 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.889740:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.889747:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787882660.890275:0:6733:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787882660.890433:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df77c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.890444:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df77c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.890452:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df77c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.890485:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df76e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.890492:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df76e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.890499:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df76e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.890512:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882660.890517:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df76e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.890524:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df76e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.890537:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:2.0:1787882660.890540:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882660.890545:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df76e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.890551:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df76e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787882660.890563:0:6733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bea9480 reply state 000000000ecfeb62 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882660.890572:0:6733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787882660.890602:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df767 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84321b expref: 19 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.890616:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df77c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84321b expref: 18 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.890623:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00500) 00010000:00010000:2.0:1787882660.890626:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787882660.890628:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264800, rc 0) 00000100:00100000:2.0:1787882660.890708:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:11389:x1874730541973760:12345-192.168.206.21@tcp:101:bash.0 Request processed in 1258us (1540us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787882660.890735:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 143 00010000:00010000:3.0:1787882660.893174:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882660.893189:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df775 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882660.893197:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df775 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882660.893204:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882660.893208:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df775 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882660.893216:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df775 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882660.893231:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa285a00300) 00010000:00010000:3.0:1787882660.893235:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882660.893239:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df775 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882660.893244:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df775 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882660.896336:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882660.896764:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541973888 00000100:00100000:2.0:1787882660.896774:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541973888 00000100:00100000:2.0:1787882660.896849:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:2.0:1787882660.896860:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541973888:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1787882660.896905:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882660.896948:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df67ec3a/0xf4731e8a7c5df78a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843222 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882660.896975:0:6710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787882660.896994:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1787882660.896999:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882660.897007:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df67ec3a/0xf4731e8a7c5df78a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843222 expref: 6 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.897026:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df67ec3a/0xf4731e8a7c5df78a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843222 expref: 6 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.897038:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a200, rc 0) 00000100:00100000:2.0:1787882660.897090:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541973888:12345-192.168.206.21@tcp:101:bash.0 Request processed in 232us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882660.897097:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00080000:0.0:1787882660.897648:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787882660.900351:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882660.900477:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541974016 00000100:00100000:2.0:1787882660.900487:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541974016 00000100:00100000:2.0:1787882660.900551:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:2.0:1787882660.900561:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:11389:x1874730541974016:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1787882660.900603:0:12080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882660.900621:0:12080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843229 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.900662:0:12080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df67ec3a/0xf4731e8a7c5df78a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843222 expref: 7 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.900671:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882660.900674:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882660.900679:0:12080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 7 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.900710:0:12080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df67ec3a/0xf4731e8a7c5df78a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843222 expref: 7 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.900733:0:12080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df67ec3a/0xf4731e8a7c5df78a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843222 expref: 7 pid: 6710 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882660.900746:0:12080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf290380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12080:1874730563999872:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882660.900834:0:12080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa285328c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787882660.903625:0:12080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf290380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12080:1874730563999872:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882660.903664:0:12080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 7 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.903686:0:12080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791b800, rc 0) 00000100:00100000:2.0:1787882660.903812:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:11389:x1874730541974016:12345-192.168.206.21@tcp:101:bash.0 Request processed in 3251us (3470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882660.903821:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:0.0:1787882660.909093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882660.909506:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541974144 00000100:00100000:1.0:1787882660.909515:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541974144 00010000:00010000:1.0:1787882660.909557:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df67ec3a/0xf4731e8a7c5df78a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843222 expref: 7 pid: 6710 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882660.909606:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:1.0:1787882660.909615:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541974144:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882660.909631:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882660.909657:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df67ec3a/0xf4731e8a7c5df78a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843222 expref: 7 pid: 6710 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882660.909672:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df67ec3a/0xf4731e8a7c5df78a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843222 expref: 7 pid: 6710 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882660.909696:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df67ec3a/0xf4731e8a7c5df78a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843222 expref: 7 pid: 6710 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882660.909745:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882660.909750:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882660.909759:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 6 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882660.909768:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 6 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882660.909806:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 6 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882660.909819:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bfaf4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1874730564000000:192.168.206.21@tcp:105: 00000100:00100000:1.0:1787882660.909947:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749780 going to sleep for 11 seconds 00000100:00100000:3.0:1787882660.914262:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bfaf4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1874730564000000:192.168.206.21@tcp:105: 00010000:00010000:3.0:1787882660.914288:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882660.914336:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541974144:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 4721us (5251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882660.914347:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:0.0:1787882660.916322:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882660.916439:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541974400 00000100:00100000:2.0:1787882660.916449:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541974400 00000100:00100000:3.0:1787882660.916526:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:3.0:1787882660.916538:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:11389:x1874730541974400:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:3.0:1787882660.917044:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:11389:x1874730541974400:12345-192.168.206.21@tcp:35:bash.0 Request processed in 507us (730us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787882660.917053:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00010000:00010000:2.0:1787882660.970702:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882660.991466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882660.991765:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541974656 00000100:00100000:2.0:1787882660.991774:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541974656 00000100:00100000:2.0:1787882660.991831:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 144 00000100:00100000:2.0:1787882660.991842:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:11399:x1874730541974656:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882660.991863:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882660.992014:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5df798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843230 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882660.992123:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787882660.993121:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5df798 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843230 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.993206:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00600) 00010000:00010000:2.0:1787882660.993210:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787882660.993216:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5df798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843230 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882660.993231:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791bc00, rc 0) 00000100:00100000:2.0:1787882660.993293:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:11399:x1874730541974656:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1453us (1836us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787882660.993302:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 144 00000100:00100000:1.0:1787882660.997461:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882660.997628:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541974912 00000100:00100000:2.0:1787882660.997653:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541974912 00000100:00100000:2.0:1787882660.997757:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:2.0:1787882660.997768:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:11399:x1874730541974912:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1787882660.998057:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:11399:x1874730541974912:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 290us (604us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787882660.998065:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:0.0:1787882661.096459:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882661.096597:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541975040 00000100:00100000:2.0:1787882661.096612:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541975040 00000100:00100000:2.0:1787882661.096684:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00100000:2.0:1787882661.096696:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:11405:x1874730541975040:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882661.096737:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882661.096763:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5df7a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843237 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.097127:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df7ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.097146:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df7ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.097160:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df7ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882661.097241:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787882661.097245:0:6733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882661.097270:0:6733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df7ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.097304:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5df7a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843237 expref: 23 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.097346:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df7ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843237 expref: 22 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.097356:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:2.0:1787882661.097360:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787882661.097363:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a600, rc 0) 00000100:00100000:2.0:1787882661.097514:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:11405:x1874730541975040:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 819us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882661.097522:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00100000:0.0:1787882661.117687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882661.117895:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541975296 00000100:00100000:3.0:1787882661.117907:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541975296 00000100:00100000:3.0:1787882661.117963:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 146 00000100:00100000:3.0:1787882661.117974:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:11405:x1874730541975296:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882661.117996:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882661.118021:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5df7b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84323e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.118119:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5df7bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.118132:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5df7bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.118144:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5df7bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882661.118173:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787882661.118298:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5df7b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84323e expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.118319:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5df7bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84323e expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.118328:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00500) 00010000:00010000:3.0:1787882661.118330:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882661.118334:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031000, rc 0) 00000100:00100000:3.0:1787882661.118459:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:11405:x1874730541975296:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 485us (780us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787882661.118467:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 146 00000100:00100000:1.0:1787882661.124381:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882661.124591:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882661.124800:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541975680 00000100:00100000:0.0:1787882661.124810:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541975680 00000100:00100000:0.0:1787882661.124914:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1787882661.124925:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:2357:x1874730541975680:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882661.124940:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882661.124967:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5df7bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84323e expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.124985:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00500) 00010000:00010000:0.0:1787882661.124990:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882661.125111:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:2357:x1874730541975680:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 186us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882661.125127:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:3.0:1787882661.126387:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541975552 00000100:00100000:3.0:1787882661.126398:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541975552 00000100:00100000:3.0:1787882661.126451:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 147 00000100:00100000:3.0:1787882661.126461:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:11405:x1874730541975552:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882661.126481:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882661.126653:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5df7c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843245 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.126759:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df7d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.126773:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df7d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.126797:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df7d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882661.126809:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787882661.126974:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5df7c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843245 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.126992:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df7d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843245 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.126999:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00500) 00010000:00010000:3.0:1787882661.127002:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787882661.127005:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264600, rc 0) 00000100:00100000:3.0:1787882661.127163:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+25:11405:x1874730541975552:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 702us (2571us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787882661.127170:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 147 00000100:00100000:1.0:1787882661.132153:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882661.132263:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541975808 00000100:00100000:2.0:1787882661.132272:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541975808 00000100:00100000:2.0:1787882661.132328:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:2.0:1787882661.132339:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541975808:12345-192.168.206.21@tcp:1:lfs.0 00010000:00010000:2.0:1787882661.132384:0:6711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.132404:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 6 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.132413:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882661.132417:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882661.132421:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.132454:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 6 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.132482:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 6 pid: 12080 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882661.132496:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf290380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6711:1874730564000128:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882661.132605:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28809b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787882661.136769:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf290380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6711:1874730564000128:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882661.136797:0:6711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882661.138663:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882661.139030:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541975936 00000100:00100000:2.0:1787882661.139040:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541975936 00002000:00100000:2.0:1787882661.139087:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fa2c15a8e00 x1874730541975936/t0(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:392/0 lens 504/0 e 0 to 0 dl 1787882672 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787882661.139100:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2c15a8e00 with x1874730541975936 ext(0->12) 00010000:00010000:2.0:1787882661.139109:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 7 pid: 12080 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.139126:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 7 pid: 12080 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882661.139134:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa2c15a8e00 00000100:00100000:2.0:1787882661.139164:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:2.0:1787882661.139173:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730541975936:12345-192.168.206.21@tcp:4:lfs.0 00000100:00100000:2.0:1787882661.139729:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2356:x1874730541975936:12345-192.168.206.21@tcp:4:lfs.0 Request processed in 555us (1071us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787882661.139738:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00002000:00100000:2.0:1787882661.139745:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fa2c15a8e00 x1874730541975936/t4294967305(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:392/0 lens 504/448 e 0 to 0 dl 1787882672 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787882661.139754:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2c15a8e00 with x1874730541975936 ext(0->12) 00010000:00010000:2.0:1787882661.139760:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 9 pid: 12080 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.139773:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 9 pid: 12080 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882661.139779:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa2c15a8e00 00000100:00100000:0.0:1787882661.143968:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882661.144051:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541976064 00000100:00100000:3.0:1787882661.144061:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541976064 00010000:00010000:3.0:1787882661.144099:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 9 pid: 12080 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882661.144131:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:3.0:1787882661.144141:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2356:x1874730541976064:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882661.144155:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787882661.144174:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787882661.144177:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787882660 00002000:00010000:3.0:1787882661.144186:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787882660 00002000:00010000:3.0:1787882661.144189:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787882660 00010000:00010000:3.0:1787882661.144196:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 9 pid: 12080 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.144210:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 9 pid: 12080 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.144231:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c46694ff/0xf4731e8a7c5df791 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843229 expref: 9 pid: 12080 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.144246:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787882661.144251:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787882661.144257:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.144266:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.144302:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882661.144366:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730541976064:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 225us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882661.144374:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 62 00010000:00010000:2.0:1787882661.145738:0:6711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.145753:0:6711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.145784:0:6711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.145793:0:6711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.145817:0:6711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.145823:0:6711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791ae00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882661.145828:0:6711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.145836:0:6711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.145851:0:6711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.145859:0:6711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5df7de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882661.145977:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541975808:12345-192.168.206.21@tcp:1:lfs.0 Request processed in 13637us (13830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882661.145985:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:0.0:1787882661.149403:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882661.149665:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541976320 00000100:00100000:3.0:1787882661.149674:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541976320 00000100:00100000:3.0:1787882661.149738:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:3.0:1787882661.149748:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa288320850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+25:11405:x1874730541976320:12345-192.168.206.21@tcp:35:lfs.0 00000004:00010000:3.0:1787882661.149825:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df7d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843245 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787882661.150094:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787882661.150156:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787882661.151332:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1787882661.151398:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.151417:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df77c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84321b expref: 29 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.151426:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.151463:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df77c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84321b expref: 29 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.151479:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df77c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84321b expref: 29 pid: 6733 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882661.151787:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1525500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1874730564000256:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882661.151995:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787882661.155548:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882661.155733:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541976448 00000100:00100000:0.0:1787882661.155742:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541976448 00010000:00010000:0.0:1787882661.155778:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df77c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84321b expref: 30 pid: 6733 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882661.155818:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:0.0:1787882661.155827:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:2357:x1874730541976448:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882661.155841:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882661.155849:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df77c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84321b expref: 30 pid: 6733 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.155862:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df77c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84321b expref: 30 pid: 6733 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.155913:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00500) 00010000:00010000:0.0:1787882661.155920:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.155928:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.155935:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.155953:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882661.156013:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:2357:x1874730541976448:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 186us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882661.156021:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 63 00010000:00010000:3.0:1787882661.157434:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df77c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84321b expref: 29 pid: 6733 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882661.157455:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1525500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1874730564000256:192.168.206.21@tcp:104: 00010000:00010000:3.0:1787882661.157478:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.157706:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.157725:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882661.157837:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787882661.158234:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787882661.158339:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf290380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874730564000384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787882661.158399:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882661.158476:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b72c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787882661.158567:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564000384 00000100:00100000:0.0:1787882661.158574:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564000384 00000100:00100000:0.0:1787882661.158729:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787882661.158739:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1874730564000384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787882661.158815:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1874730564000384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882661.158822:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787882661.158925:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf290380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874730564000384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787882661.159326:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787882661.159381:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1525500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874730564000512:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787882661.159414:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882661.159429:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157840 going to sleep for 11 seconds 00000100:00100000:0.0:1787882661.159620:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564000512 00000100:00100000:0.0:1787882661.159626:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564000512 00000100:00100000:0.0:1787882661.159652:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787882661.159659:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1874730564000512:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787882661.159828:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1874730564000512:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (411us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787882661.159845:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787882661.160035:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1525500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874730564000512:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787882661.160083:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787882661.160120:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.160130:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.160149:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.160156:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882661.160161:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.160168:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.160183:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00500) 00010000:00010000:3.0:1787882661.160186:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787882661.160190:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.160196:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df7e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787882661.160375:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787882661.160533:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1787882661.160544:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377309673831ns, next at 378309671664ns, rc = 0 00000001:00080000:3.0:1787882661.160551:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787882661.160597:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00500) 00010000:00010000:3.0:1787882661.160601:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787882661.160607:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df7d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843245 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882661.160702:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa288320850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:11405:x1874730541976320:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 10955us (11308us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1787882661.160711:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00000020:00080000:3.0:1787882661.160725:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787882661.162171:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564000640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882661.162230:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882661.162332:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564000640 00000100:00100000:1.0:1787882661.162340:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564000640 00000100:00100000:1.0:1787882661.162386:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787882661.162396:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730564000640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882661.162417:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882661.162461:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730564000640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882661.162481:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787882661.162573:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564000640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882661.164534:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730564001024:0@lo:400:kworker.0 00000100:00100000:0.0:1787882661.164601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882661.164637:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787882661.164642:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730564001152:0@lo:400:kworker.0 00000100:00100000:0.0:1787882661.164672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787882661.164705:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882661.164710:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564001024 00000100:00100000:0.0:1787882661.164727:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564001024 00000100:00100000:2.0:1787882661.164735:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730564000896:0@lo:400:kworker.0 00000100:00100000:2.0:1787882661.164772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882661.164774:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564001152 00000100:00100000:0.0:1787882661.164779:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564001152 00000100:00100000:0.0:1787882661.164800:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564000896 00000100:00100000:0.0:1787882661.164803:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564000896 00000100:00100000:0.0:1787882661.164835:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787882661.164843:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730564001024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882661.164903:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730564001024:12345-0@lo:400:kworker.0 Request processed in 61us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882661.164909:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787882661.164935:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787882661.164941:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730564001152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882661.164968:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730564001152:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882661.164973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787882661.164987:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787882661.164992:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730564000896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882661.165022:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730564000896:12345-0@lo:400:kworker.0 Request processed in 29us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882661.165028:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787882661.165065:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730564001152:0@lo:400:kworker.0 00000100:00100000:2.0:1787882661.165070:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787882661.165078:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730564001024:0@lo:400:kworker.0 00000100:00100000:2.0:1787882661.165083:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730564000768:0@lo:400:kworker.0 00000100:00100000:2.0:1787882661.165120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882661.165154:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564001280:0@lo:400:kworker.0 00000100:00100000:0.0:1787882661.165155:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564000768 00000100:00100000:0.0:1787882661.165161:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564000768 00000100:00100000:0.0:1787882661.165194:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787882661.165201:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730564000768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882661.165234:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730564000768:12345-0@lo:400:kworker.0 Request processed in 34us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882661.165240:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787882661.165270:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882661.165304:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564001280 00000100:00100000:2.0:1787882661.165312:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730564000896:0@lo:400:kworker.0 00000100:00100000:0.0:1787882661.165317:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564001280 00000100:00100000:2.0:1787882661.165342:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730564000768:0@lo:400:kworker.0 00000100:00100000:0.0:1787882661.165355:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787882661.165364:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564001280:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787882661.165365:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787882661.165370:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882661.165419:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564001280:12345-0@lo:400:kworker.0 Request processed in 56us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882661.165425:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787882661.165485:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564001280:0@lo:400:kworker.0 00000100:00100000:0.0:1787882661.166186:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882661.166401:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541976576 00000100:00100000:2.0:1787882661.166407:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541976576 00000100:00100000:2.0:1787882661.166450:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 148 00000100:00100000:2.0:1787882661.166459:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:11405:x1874730541976576:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882661.166478:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882661.166498:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b000/0xf4731e8a7c5df7ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84324c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.166569:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b000/0xf4731e8a7c5df7ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84324c expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.166593:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b000/0xf4731e8a7c5df7ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84324c expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.166614:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882661.166617:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787882661.166621:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791b000, rc 0) 00000100:00100000:2.0:1787882661.166674:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:11405:x1874730541976576:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 216us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882661.166681:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 148 00000100:00100000:0.0:1787882661.170628:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882661.170706:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541976832 00000100:00100000:2.0:1787882661.170726:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541976832 00000100:00100000:2.0:1787882661.170780:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:2.0:1787882661.170789:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:11405:x1874730541976832:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1787882661.171018:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:11405:x1874730541976832:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 230us (398us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787882661.171026:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:0.0:1787882661.303327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882661.303412:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541977088 00000100:00100000:3.0:1787882661.303422:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541977088 00000100:00100000:3.0:1787882661.303484:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 149 00000100:00100000:3.0:1787882661.303494:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:11415:x1874730541977088:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882661.303519:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882661.303538:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df7f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843253 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882661.303648:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787882661.303797:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df7f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843253 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.303811:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00600) 00010000:00010000:3.0:1787882661.303814:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787882661.303820:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df7f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843253 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.303833:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264600, rc 0) 00000100:00100000:3.0:1787882661.304077:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:11415:x1874730541977088:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 583us (759us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1787882661.304085:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 149 00000100:00100000:0.0:1787882661.313604:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882661.313804:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541977216 00000100:00100000:2.0:1787882661.313816:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541977216 00000100:00100000:2.0:1787882661.313897:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 150 00000100:00100000:2.0:1787882661.313908:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:11415:x1874730541977216:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:2.0:1787882661.313979:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df801 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.313995:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314020:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314036:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df808 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314043:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314049:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314142:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df80f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314152:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df80f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314159:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df80f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787882661.314196:0:6733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df80f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314209:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314216:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df801 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314223:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df801 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314241:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791a400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882661.314245:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df801 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314253:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df801 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314266:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:2.0:1787882661.314269:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882661.314274:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df801 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314280:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df801 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314292:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314298:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df808 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314305:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314310:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791aa00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882661.314312:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314317:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314335:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa285a00c00) 00010000:00010000:2.0:1787882661.314338:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882661.314341:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df808 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314348:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df808 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314363:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df80f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314369:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df80f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314375:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df80f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314380:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791ba00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882661.314382:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df80f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314388:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df80f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314395:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882661.314397:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882661.314400:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df80f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.314405:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df80f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882661.314492:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:11415:x1874730541977216:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 585us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882661.314500:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 150 00000100:00100000:2.0:1787882661.317551:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882661.318055:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541977472 00000100:00100000:3.0:1787882661.318065:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541977472 00000100:00100000:3.0:1787882661.318117:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:3.0:1787882661.318127:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:11415:x1874730541977472:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1787882661.318402:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:11415:x1874730541977472:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 272us (855us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787882661.318409:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:3.0:1787882661.399270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882661.403476:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541977728 00000100:00100000:0.0:1787882661.403493:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541977728 00000100:00100000:0.0:1787882661.403568:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 151 00000100:00100000:0.0:1787882661.403737:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:11418:x1874730541977728:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882661.403846:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882661.403885:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df816 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84325a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.403955:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df81d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.403968:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df81d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.403979:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df81d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.403993:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404000:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404007:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404125:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df82b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404133:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df82b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404168:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df82b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882661.404179:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787882661.404275:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df81d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404283:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df81d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404289:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df81d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404295:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791aa00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882661.404300:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df81d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404308:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df81d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404320:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:2.0:1787882661.404324:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882661.404328:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df81d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404334:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df81d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404347:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404353:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df824 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404366:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404372:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791a400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882661.404375:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404382:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df824 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404390:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa285a00c00) 00010000:00010000:2.0:1787882661.404393:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882661.404396:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df824 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404401:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404445:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df816 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84325a expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404459:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df82b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84325a expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.404465:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882661.404467:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787882661.404469:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a800, rc 0) 00000100:00100000:2.0:1787882661.404543:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11418:x1874730541977728:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 965us (5284us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787882661.404560:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 151 00000100:00100000:0.0:1787882661.410481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882661.410555:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541977856 00000100:00100000:2.0:1787882661.410565:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541977856 00000100:00100000:2.0:1787882661.410621:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 152 00000100:00100000:2.0:1787882661.410632:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11418:x1874730541977856:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:2.0:1787882661.410708:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df839 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.410735:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.410746:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.410772:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.410779:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df839 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.410786:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.410793:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791ba00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882661.410797:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.410805:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df839 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.410816:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882661.410832:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787882661.410837:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df839 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.410843:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df839 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882661.410953:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11418:x1874730541977856:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 321us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882661.410961:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 152 00000100:00100000:0.0:1787882661.416992:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882661.417129:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541978112 00000100:00100000:3.0:1787882661.417139:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541978112 00000100:00100000:3.0:1787882661.417195:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:3.0:1787882661.417207:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11418:x1874730541978112:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1787882661.417438:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+39:11418:x1874730541978112:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 233us (457us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787882661.417462:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:0.0:1787882661.674040:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564001408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787882661.674106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882661.692380:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564001408 00000100:00100000:3.0:1787882661.692394:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564001408 00000100:00100000:3.0:1787882661.692476:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787882661.692486:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564001408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787882661.692524:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882661.692759:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564001408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 273us (18652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882661.692766:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787882661.693079:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564001408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787882661.724641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882661.724805:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541978368 00000100:00100000:2.0:1787882661.724815:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541978368 00000100:00100000:2.0:1787882661.724897:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 153 00000100:00100000:2.0:1787882661.724908:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+39:11449:x1874730541978368:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:2.0:1787882661.724931:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882661.724950:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df840 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843261 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.725047:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.725061:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.725073:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882661.725085:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787882661.725292:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df840 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843261 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.725327:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843261 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.725336:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882661.725339:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787882661.725343:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a400, rc 0) 00000100:00100000:2.0:1787882661.725401:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:11449:x1874730541978368:12345-192.168.206.21@tcp:101:cat.0 Request processed in 493us (766us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787882661.725408:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 153 00000100:00100000:2.0:1787882661.729945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882661.729993:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541978624 00000100:00100000:2.0:1787882661.730002:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541978624 00000100:00100000:2.0:1787882661.730052:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:2.0:1787882661.730062:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:11449:x1874730541978624:12345-192.168.206.21@tcp:35:cat.0 00000100:00100000:2.0:1787882661.730304:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+42:11449:x1874730541978624:12345-192.168.206.21@tcp:35:cat.0 Request processed in 242us (368us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787882661.730311:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 42 00000001:00080000:1.0:1787882661.743202:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000001:00080000:1.0:1787882661.743220:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000001:00080000:1.0:1787882661.743241:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000004:00080000:1.0:1787882661.743253:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787882661.743280:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa2b7157e40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787882661.743285:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2b946f700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa2b7157b40 00000020:00080000:1.0:1787882661.743288:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2b946fa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa281385400 00000020:00080000:2.0:1787882661.743357:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787882661.743785:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787882661.744084:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564001536:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787882661.744154:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882661.744350:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564001536 00000100:00100000:0.0:1787882661.744358:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564001536 00000100:00100000:0.0:1787882661.744409:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787882661.744419:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730564001536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787882661.744443:0:12080:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1787882661.744475:0:12080:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a90eca4, atime: 0x6a90eca4, ctime: 0x6a90eca4, blocks: 0x1 00010000:00010000:0.0:1787882661.744492:0:12080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5df855 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.744519:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1787882661.744523:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882661.744529:0:12080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5df855 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.744543:0:12080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5df855 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.744553:0:12080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5df855 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.744560:0:12080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5df855 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.744695:0:12080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787882661.744961:0:11677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882661.744968:0:11677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5df855 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.744977:0:11677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882661.744981:0:11677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5df855 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.744989:0:11677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5df855 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.745005:0:11677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5df855 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.745012:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5df855 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.745042:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882661.745044:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882661.745046:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882661.745466:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3307:x1874730564001536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1047us (1310us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787882661.745475:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1787882661.746023:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2af849500/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787882661.746031:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564001536:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787882661.747967:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882661.748226:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541978752 00000100:00100000:3.0:1787882661.748236:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541978752 00000100:00100000:3.0:1787882661.748297:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1787882661.748307:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d851450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:2357:x1874730541978752:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882661.748323:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882661.748346:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df847 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843261 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.748364:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:3.0:1787882661.748368:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882661.748423:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d851450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:2357:x1874730541978752:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 117us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882661.748431:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:2.0:1787882661.817192:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882661.817365:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541979008 00000100:00100000:0.0:1787882661.817376:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541979008 00000100:00100000:0.0:1787882661.817436:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 154 00000100:00100000:0.0:1787882661.817448:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:11455:x1874730541979008:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1787882661.817475:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882661.817479:0:6733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787882661.817516:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df7ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843237 expref: 19 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.817552:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:0.0:1787882661.817556:0:6733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787882661.817571:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df85c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843268 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.817677:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.817692:0:6733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df82b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84325a expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.817700:0:6733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.817743:0:6733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df82b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84325a expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.817756:0:6733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df82b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84325a expref: 19 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882661.817769:0:6733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730564001664:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882661.817930:0:6733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787882661.821260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882661.821617:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541979136 00000100:00100000:3.0:1787882661.821626:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541979136 00010000:00010000:3.0:1787882661.821662:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df82b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84325a expref: 20 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882661.821703:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:3.0:1787882661.821733:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:2357:x1874730541979136:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882661.821761:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882661.821769:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df82b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84325a expref: 20 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.821783:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df82b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84325a expref: 20 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.821805:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:3.0:1787882661.821811:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.821820:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.821827:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882661.821845:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882661.821930:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:2357:x1874730541979136:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 218us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882661.821938:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00010000:00010000:0.0:1787882661.822278:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df82b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84325a expref: 19 pid: 5844 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882661.822294:0:6733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730564001664:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882661.822325:0:6733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.822335:0:6733:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.822341:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882661.822357:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787882661.822508:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5df85c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843268 expref: 20 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.822525:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843268 expref: 19 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.822532:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:0.0:1787882661.822535:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787882661.822538:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9000, rc 0) 00000100:00100000:0.0:1787882661.822567:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:11455:x1874730541979008:12345-192.168.206.21@tcp:101:dd.0 Request processed in 5122us (5384us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787882661.822588:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 154 00000100:00100000:3.0:1787882661.825186:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882661.825256:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541979392 00000100:00100000:2.0:1787882661.825275:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541979392 00000100:00100000:2.0:1787882661.825322:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 155 00000100:00100000:2.0:1787882661.825331:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:11455:x1874730541979392:12345-192.168.206.21@tcp:36:dd.0 00010000:00010000:2.0:1787882661.825647:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df871 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.825663:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.825673:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882661.825736:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787882661.825762:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edba5508 reply state 000000006bed3ee4 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882661.825770:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787882661.826010:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:11455:x1874730541979392:12345-192.168.206.21@tcp:36:dd.0 Request processed in 678us (830us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787882661.826017:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 155 00000020:00080000:2.0:1787882661.826021:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787882661.833758:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df871 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.833777:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df871 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.833785:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df871 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.833810:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882661.833815:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df871 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.833822:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df871 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.833839:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:0.0:1787882661.833842:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882661.833847:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df871 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882661.833852:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df871 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882661.994125:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882662.101386:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.102054:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541979520 00000100:00100000:2.0:1787882662.102064:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541979520 00000100:00100000:2.0:1787882662.102139:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 156 00000100:00100000:2.0:1787882662.102149:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:11469:x1874730541979520:12345-192.168.206.21@tcp:101:stat.0 00010000:00010000:2.0:1787882662.102171:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882662.102189:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df878 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84326f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787882662.102330:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787882662.102401:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df87f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.102415:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df87f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.102426:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df87f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.102441:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.102448:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.102455:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.102954:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.102968:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843268 expref: 22 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.102976:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.103010:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843268 expref: 22 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.103035:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843268 expref: 22 pid: 6733 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882662.103049:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730564001792:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882662.103156:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b64799c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882662.107171:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730564001792:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882662.107198:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882662.120911:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.121684:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541979776 00000100:00100000:2.0:1787882662.121695:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541979776 00000100:00100000:2.0:1787882662.121778:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:2.0:1787882662.121789:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:6067:x1874730541979776:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787882662.122153:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:6067:x1874730541979776:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 364us (1250us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787882662.122161:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:3.0:1787882662.125050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882662.125159:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541979904 00000100:00100000:1.0:1787882662.125168:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541979904 00010000:00010000:1.0:1787882662.125208:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843268 expref: 24 pid: 6733 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882662.125249:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:1.0:1787882662.125260:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1526a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:2356:x1874730541979904:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882662.125273:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882662.125279:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843268 expref: 24 pid: 6733 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882662.125293:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843268 expref: 24 pid: 6733 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882662.125312:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9000/0xf4731e8a7c5df863 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843268 expref: 24 pid: 6733 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882662.125507:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:1.0:1787882662.125514:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882662.125524:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882662.125533:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882662.125564:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882662.127103:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1526a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:2356:x1874730541979904:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1837us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882662.127116:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00010000:00010000:2.0:1787882662.129593:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129610:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882662.129663:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787882662.129667:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882662.129694:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129737:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129748:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df87f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129754:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df87f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129760:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df87f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129765:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882662.129769:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df87f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129777:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df87f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129791:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:2.0:1787882662.129794:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882662.129799:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df87f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129805:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df87f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129831:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129838:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df886 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129852:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129857:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882662.129860:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129866:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129915:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa285a00c00) 00010000:00010000:2.0:1787882662.129917:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882662.129920:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df886 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129925:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129969:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df878 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84326f expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129983:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84326f expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.129991:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882662.129993:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787882662.129995:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a800, rc 0) 00000100:00100000:2.0:1787882662.130053:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:11469:x1874730541979520:12345-192.168.206.21@tcp:101:stat.0 Request processed in 27904us (28674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882662.130073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 156 00000100:00100000:1.0:1787882662.217405:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.217501:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541980160 00000100:00100000:2.0:1787882662.217510:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541980160 00000100:00100000:2.0:1787882662.217563:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 157 00000100:00100000:2.0:1787882662.217573:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:11475:x1874730541980160:12345-192.168.206.21@tcp:36:truncate.0 00010000:00010000:2.0:1787882662.217628:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882662.217652:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df88d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84326f expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.217670:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882662.217675:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787882662.217928:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df894 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.217943:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.217953:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882662.218008:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787882662.218034:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024109a5a reply state 00000000e14939a1 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882662.218042:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787882662.218131:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:11475:x1874730541980160:12345-192.168.206.21@tcp:36:truncate.0 Request processed in 559us (734us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787882662.218139:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 157 00000020:00080000:2.0:1787882662.218158:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787882662.226046:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.226062:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df894 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.226069:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df894 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.226075:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791ac00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882662.226081:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df894 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.226089:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df894 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.226126:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:0.0:1787882662.226129:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882662.226134:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df894 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.226140:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ac00/0xf4731e8a7c5df894 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882662.475851:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882662.475991:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541980288 00000100:00100000:3.0:1787882662.476000:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541980288 00000100:00100000:3.0:1787882662.476058:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 158 00000100:00100000:3.0:1787882662.476067:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:11489:x1874730541980288:12345-192.168.206.21@tcp:101:stat.0 00010000:00010000:3.0:1787882662.476101:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882662.476120:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df89b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843276 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476185:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df8a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476198:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df8a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476209:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df8a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476222:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df8a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476230:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476237:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476770:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476781:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476789:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882662.476824:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787882662.476835:0:6733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882662.476859:0:6733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476901:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476911:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df8a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476917:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df8a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476924:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df8a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476929:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882662.476933:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df8a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476942:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df8a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476954:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:3.0:1787882662.476958:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882662.476962:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df8a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476968:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5df8a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476980:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.476997:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df8a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.477003:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.477008:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882662.477011:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.477017:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df8a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.477026:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa2a0727700) 00010000:00010000:3.0:1787882662.477029:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882662.477032:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df8a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.477039:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df8a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.477071:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df89b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843276 expref: 25 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.477084:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843276 expref: 24 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.477091:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:3.0:1787882662.477094:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882662.477102:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265600, rc 0) 00000100:00100000:3.0:1787882662.477284:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:11489:x1874730541980288:12345-192.168.206.21@tcp:101:stat.0 Request processed in 1216us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882662.477292:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 158 00000100:00100000:3.0:1787882662.578594:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882662.578636:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882662.578664:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882662.578696:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.578945:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541980416 00000100:00100000:2.0:1787882662.578954:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541980416 00000100:00100000:2.0:1787882662.579013:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 295 00000100:00100000:2.0:1787882662.579024:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2358:x1874730541980416:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882662.579091:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2358:x1874730541980416:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882662.579099:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 295 00000100:00100000:2.0:1787882662.579136:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541980800 00000100:00100000:2.0:1787882662.579140:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541980800 00000100:00100000:2.0:1787882662.579179:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 154 00000100:00100000:2.0:1787882662.579186:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541980800:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882662.579230:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730541980800:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882662.579238:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 154 00000100:00080000:2.0:1787882662.579255:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882662.579394:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541980672 00000100:00100000:1.0:1787882662.579399:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541980672 00000100:00100000:1.0:1787882662.579448:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541980544 00000100:00100000:1.0:1787882662.579452:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541980544 00000100:00100000:1.0:1787882662.579473:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:1.0:1787882662.579492:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541980672:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882662.579520:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541980672:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882662.579527:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:1.0:1787882662.579539:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:1.0:1787882662.579544:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2358:x1874730541980544:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882662.579582:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2358:x1874730541980544:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882662.579588:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00080000:2.0:1787882662.580062:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787882662.580066:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787882662.611650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.611786:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541981056 00000100:00100000:2.0:1787882662.611796:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541981056 00000100:00100000:2.0:1787882662.611853:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 159 00000100:00100000:2.0:1787882662.611864:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:11500:x1874730541981056:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882662.611928:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882662.611949:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df8b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84327d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882662.612204:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787882662.612383:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df8b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84327d expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.612398:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00600) 00010000:00010000:2.0:1787882662.612401:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787882662.612406:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df8b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84327d expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.612419:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a800, rc 0) 00000100:00100000:2.0:1787882662.612805:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+25:11500:x1874730541981056:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 941us (1161us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787882662.612813:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 159 00000100:00100000:1.0:1787882662.616512:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.616590:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541981312 00000100:00100000:2.0:1787882662.616601:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541981312 00000100:00100000:2.0:1787882662.616655:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:2.0:1787882662.616664:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa288321850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+25:11500:x1874730541981312:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1787882662.617110:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa288321850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:11500:x1874730541981312:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 444us (604us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787882662.617117:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:0.0:1787882662.695982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.696107:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541981568 00000100:00100000:2.0:1787882662.696118:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541981568 00000100:00100000:2.0:1787882662.696196:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 160 00000100:00100000:2.0:1787882662.696210:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:11506:x1874730541981568:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1787882662.696235:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882662.696256:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df8c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843284 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.696378:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.696393:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843276 expref: 27 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.696402:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.696436:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843276 expref: 27 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.696450:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843276 expref: 27 pid: 6733 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882662.696462:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730564001920:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882662.696781:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6479300 going to sleep for 11 seconds 00000100:00100000:0.0:1787882662.704532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882662.704947:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541981696 00000100:00100000:3.0:1787882662.704959:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541981696 00010000:00010000:3.0:1787882662.704999:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843276 expref: 28 pid: 6733 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882662.705033:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:3.0:1787882662.705042:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:2357:x1874730541981696:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882662.705056:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882662.705062:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843276 expref: 28 pid: 6733 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.705074:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843276 expref: 28 pid: 6733 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.705096:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:3.0:1787882662.705101:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.705110:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.705134:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.705165:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882662.705223:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:2357:x1874730541981696:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 182us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882662.705231:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00010000:00010000:2.0:1787882662.706721:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5df8b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843276 expref: 27 pid: 6733 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882662.706742:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730564001920:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882662.706762:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.706770:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.706790:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882662.707038:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787882662.707282:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df8c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843284 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.707299:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843284 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.707307:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882662.707310:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787882662.707314:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791b200, rc 0) 00000100:00100000:2.0:1787882662.707404:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:11506:x1874730541981568:12345-192.168.206.21@tcp:101:bash.0 Request processed in 11195us (11430us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787882662.707412:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 160 00000100:00100000:0.0:1787882662.710799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.710899:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541981952 00000100:00100000:2.0:1787882662.710909:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541981952 00000100:00100000:2.0:1787882662.711005:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 161 00000100:00100000:2.0:1787882662.711016:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:11506:x1874730541981952:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:2.0:1787882662.711269:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df8da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.711285:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.711296:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882662.711355:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787882662.711382:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b76be0d8 reply state 000000001e31c204 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882662.711391:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787882662.711864:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:11506:x1874730541981952:12345-192.168.206.21@tcp:36:bash.0 Request processed in 465us (688us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787882662.711901:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 161 00000020:00080000:2.0:1787882662.711907:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787882662.715730:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.715748:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df8da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.715756:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df8da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.715762:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882662.715767:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df8da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.715775:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df8da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.715791:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:0.0:1787882662.715794:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882662.715811:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df8da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.715818:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5df8da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882662.718524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.718619:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541982080 00000100:00100000:2.0:1787882662.718628:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541982080 00000100:00100000:2.0:1787882662.718690:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 162 00000100:00100000:2.0:1787882662.718712:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:11506:x1874730541982080:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1787882662.718739:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882662.718759:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df8e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84328b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.718843:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df8e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.718858:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843284 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.718866:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df8e8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.718930:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843284 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.718963:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843284 expref: 30 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882662.718977:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730564002048:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882662.719051:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b64793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882662.722538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882662.722613:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541982208 00000100:00100000:3.0:1787882662.722623:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541982208 00010000:00010000:3.0:1787882662.722661:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843284 expref: 31 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882662.722699:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:3.0:1787882662.722719:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:2356:x1874730541982208:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882662.722733:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882662.722740:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843284 expref: 31 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.722752:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843284 expref: 31 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.722771:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:3.0:1787882662.722776:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df8e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.722784:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.722808:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df8e8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.722827:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882662.722909:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:2356:x1874730541982208:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 201us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882662.722917:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 67 00010000:00010000:2.0:1787882662.723304:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df8cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843284 expref: 30 pid: 5844 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882662.723320:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730564002048:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882662.723340:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.723348:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.723354:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882662.723397:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787882662.723401:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882662.723418:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.723446:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df8e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84328b expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.723458:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df8e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84328b expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.723473:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882662.723476:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787882662.723479:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a600, rc 0) 00000100:00100000:2.0:1787882662.723518:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:11506:x1874730541982080:12345-192.168.206.21@tcp:101:bash.0 Request processed in 4819us (5005us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882662.723525:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 162 00000100:00100000:1.0:1787882662.729121:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.729266:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541982464 00000100:00100000:2.0:1787882662.729276:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541982464 00000100:00100000:2.0:1787882662.729329:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:2.0:1787882662.729340:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:11506:x1874730541982464:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:2.0:1787882662.729592:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:11506:x1874730541982464:12345-192.168.206.21@tcp:35:bash.0 Request processed in 253us (480us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787882662.729599:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:3.0:1787882662.835413:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882662.835622:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541982720 00000100:00100000:0.0:1787882662.835633:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541982720 00000100:00100000:0.0:1787882662.835691:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 163 00000100:00100000:0.0:1787882662.835701:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+30:11516:x1874730541982720:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1787882662.835735:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882662.835755:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843292 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882662.836011:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787882662.836175:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843292 expref: 32 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.836189:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00600) 00010000:00010000:0.0:1787882662.836192:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787882662.836198:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843292 expref: 32 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.836211:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8400, rc 0) 00000100:00100000:0.0:1787882662.836279:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:11516:x1874730541982720:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 580us (875us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787882662.836287:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 163 00000100:00100000:3.0:1787882662.844308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882662.844408:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541982848 00000100:00100000:0.0:1787882662.844430:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541982848 00000100:00100000:0.0:1787882662.844490:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00100000:0.0:1787882662.844499:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:11516:x1874730541982848:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:0.0:1787882662.844579:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.844596:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.844608:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.844623:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df904 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.844629:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.844636:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845003:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df90b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845014:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845021:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787882662.845059:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845081:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845087:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845093:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845099:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882662.845103:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845110:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845121:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:0.0:1787882662.845124:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882662.845128:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845134:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df8fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845160:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df904 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845166:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df904 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845172:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845183:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882662.845187:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df904 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845193:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df904 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845201:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa289160300) 00010000:00010000:0.0:1787882662.845203:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882662.845206:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df904 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845212:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df904 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845235:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845242:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df90b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845247:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df90b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845251:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882662.845254:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df90b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845259:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df90b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845277:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:0.0:1787882662.845280:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882662.845283:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df90b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.845288:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df90b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882662.845366:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:11516:x1874730541982848:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 866us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882662.845375:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00100000:1.0:1787882662.848913:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.848994:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541983104 00000100:00100000:2.0:1787882662.849004:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541983104 00000100:00100000:2.0:1787882662.849050:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:2.0:1787882662.849058:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:11516:x1874730541983104:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1787882662.849453:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:11516:x1874730541983104:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 395us (547us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787882662.849461:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:3.0:1787882662.903021:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882662.903126:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541983360 00000100:00100000:0.0:1787882662.903149:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541983360 00000100:00100000:0.0:1787882662.903207:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00100000:0.0:1787882662.903217:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:11519:x1874730541983360:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1787882662.903240:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882662.903268:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df912 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843299 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.903337:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df919 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.903351:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.903362:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.903381:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.903402:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.903409:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.903794:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df927 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.903804:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.903812:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882662.903822:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787882662.904760:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df919 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904772:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df919 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904779:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904785:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882662.904789:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904797:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df919 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904907:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:0.0:1787882662.904910:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882662.904915:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df919 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904922:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5df919 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904935:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904941:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df920 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904947:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904953:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882662.904956:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904962:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df920 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904969:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa289160300) 00010000:00010000:0.0:1787882662.904971:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882662.904973:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df920 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.904979:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5df920 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.905050:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df912 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843299 expref: 35 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.905065:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843299 expref: 34 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882662.905072:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:0.0:1787882662.905074:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882662.905077:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9800, rc 0) 00000100:00100000:0.0:1787882662.905289:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:11519:x1874730541983360:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 2072us (2275us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787882662.905298:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00100000:0.0:1787882662.915736:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882662.915806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882662.916723:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541983616 00000100:00100000:3.0:1787882662.916734:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541983616 00000100:00100000:3.0:1787882662.916793:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:3.0:1787882662.916804:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:2356:x1874730541983616:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882662.916818:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882662.916841:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5df927 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843299 expref: 34 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882662.916862:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:3.0:1787882662.916892:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882662.916947:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:2356:x1874730541983616:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 144us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882662.916954:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:2.0:1787882662.917129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541983488 00000100:00100000:2.0:1787882662.917135:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541983488 00000100:00100000:2.0:1787882662.917175:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 166 00000100:00100000:2.0:1787882662.917183:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:11519:x1874730541983488:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:2.0:1787882662.917282:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df935 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.917297:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.917308:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.917335:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.917343:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df935 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.917349:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.917354:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791a800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882662.917359:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.917366:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df935 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.917374:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882662.917377:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787882662.917380:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df935 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882662.917386:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df935 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882662.917437:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:11519:x1874730541983488:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 254us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882662.917443:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 166 00000100:00100000:0.0:1787882662.923052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882662.923284:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541983872 00000100:00100000:2.0:1787882662.923294:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541983872 00000100:00100000:2.0:1787882662.923339:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:2.0:1787882662.923348:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+33:11519:x1874730541983872:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1787882662.923607:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:11519:x1874730541983872:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 259us (563us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787882662.923615:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 47 00010000:00010000:0.0:1787882663.018094:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787882663.082110:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882663.082120:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882663.082473:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787882663.082553:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787882663.091949:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882663.092041:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541984128 00000100:00100000:2.0:1787882663.092050:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541984128 00000100:00100000:2.0:1787882663.092105:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 167 00000100:00100000:2.0:1787882663.092116:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:11537:x1874730541984128:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:2.0:1787882663.092138:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882663.092157:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df93c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432a0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.092249:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df943 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.092261:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df943 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.092273:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df943 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882663.092300:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787882663.092413:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df93c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432a0 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.092428:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df943 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432a0 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.092435:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882663.092437:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787882663.092440:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791b200, rc 0) 00000100:00100000:2.0:1787882663.092498:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:11537:x1874730541984128:12345-192.168.206.21@tcp:101:cat.0 Request processed in 384us (558us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787882663.092505:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 167 00000100:00100000:3.0:1787882663.134784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882663.134908:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541984256 00000100:00100000:2.0:1787882663.134918:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541984256 00000100:00100000:2.0:1787882663.134974:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 168 00000100:00100000:2.0:1787882663.134983:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:11538:x1874730541984256:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882663.135006:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882663.135025:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432a7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.135104:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5df958 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.135117:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5df958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.135139:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5df958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882663.135321:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787882663.135325:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882663.135399:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5df958 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.135427:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432a7 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.135443:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5df958 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432a7 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.135451:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:2.0:1787882663.135454:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787882663.135458:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a000, rc 0) 00000100:00100000:2.0:1787882663.135528:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:11538:x1874730541984256:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 545us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882663.135535:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 168 00000100:00100000:3.0:1787882663.161104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882663.161594:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541984640 00000100:00100000:2.0:1787882663.161604:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541984640 00000100:00100000:2.0:1787882663.161661:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:2.0:1787882663.161671:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:11538:x1874730541984640:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1787882663.162056:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11538:x1874730541984640:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 384us (958us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787882663.162064:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:1.0:1787882663.164995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882663.165082:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541984768 00000100:00100000:3.0:1787882663.165104:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541984768 00000100:00100000:3.0:1787882663.165163:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:3.0:1787882663.165173:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11538:x1874730541984768:12345-192.168.206.21@tcp:103:lfs.0 00010000:00010000:3.0:1787882663.165187:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787882663.165210:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a600/0xf4731e8a7c5df8e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84328b expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882663.165230:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5df943 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432a0 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882663.165242:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b000/0xf4731e8a7c5df7ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84324c expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882663.165251:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:3.0:1787882663.165262:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882663.165319:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:11538:x1874730541984768:12345-192.168.206.21@tcp:103:lfs.0 Request processed in 147us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882663.165327:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:3.0:1787882663.174224:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882663.174339:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541984896 00000100:00100000:2.0:1787882663.174348:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541984896 00000100:00100000:2.0:1787882663.174402:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 169 00000100:00100000:2.0:1787882663.174412:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:11538:x1874730541984896:12345-192.168.206.21@tcp:58:lfs.0 00010000:00010000:2.0:1787882663.174665:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df95f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.174680:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df95f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.174691:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df95f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787882663.175470:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787882663.176984:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:11538:x1874730541984896:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 2567us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882663.176997:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 169 00000100:00100000:0.0:1787882663.217159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882663.217314:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541985024 00000100:00100000:2.0:1787882663.217322:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541985024 00000100:00100000:2.0:1787882663.217380:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 170 00000100:00100000:2.0:1787882663.217391:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:11540:x1874730541985024:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882663.217414:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882663.217434:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df966 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432ae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.217507:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df96d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.217532:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df96d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.217555:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df96d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.217571:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df974 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.217579:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.217585:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.217952:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.217962:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.217970:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882663.218003:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787882663.218007:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882663.218025:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218037:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218045:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df96d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218063:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df96d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218070:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df96d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218076:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791a400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882663.218081:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df96d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218089:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df96d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218101:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:2.0:1787882663.218104:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882663.218109:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df96d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218115:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df96d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218126:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df974 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218132:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df974 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218139:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218144:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791be00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882663.218153:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218160:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df974 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218167:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa285a00a00) 00010000:00010000:2.0:1787882663.218170:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882663.218173:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df974 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218178:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df974 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218210:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5df966 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ae expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218224:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ae expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882663.218230:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:2.0:1787882663.218232:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787882663.218235:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791aa00, rc 0) 00000100:00100000:2.0:1787882663.218293:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:11540:x1874730541985024:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 904us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882663.218300:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 170 00000040:00080000:0.0:1787882663.965467:0:12522:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882663.965646:0:12522:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882663.965690:0:12522:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787882663.965707:0:12522:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787882664.043068:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787882664.110442:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882664.110452:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882664.110503:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787882664.110511:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787882664.110632:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b622e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730564002176:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787882664.111828:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa290247c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787882664.121544:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b622e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730564002176:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787882664.124149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882664.124316:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541985152 00000100:00100000:2.0:1787882664.124334:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541985152 00000100:00080000:3.0:1787882664.124374:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882664.124400:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 171 00000100:00100000:2.0:1787882664.124410:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:11552:x1874730541985152:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787882664.124439:0:6733:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787882664.124545:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:11552:x1874730541985152:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 136us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882664.124553:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 171 00000100:00100000:3.0:1787882664.127303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882664.127840:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541985280 00000100:00100000:2.0:1787882664.127849:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541985280 00000100:00100000:2.0:1787882664.127920:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 172 00000100:00100000:2.0:1787882664.127929:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:11552:x1874730541985280:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787882664.127995:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df982 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128011:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df982 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128023:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df982 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128038:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df989 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128045:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df989 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128051:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df989 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128075:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df990 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128093:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128101:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882664.128135:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787882664.128139:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882664.128150:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128161:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df982 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128168:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df982 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128175:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df982 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128181:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791be00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882664.128185:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df982 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128193:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df982 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128205:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:2.0:1787882664.128209:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882664.128213:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df982 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128229:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df982 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128241:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df989 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128247:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df989 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128253:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df989 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128257:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791a400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882664.128261:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df989 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128266:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df989 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128274:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9fa285a00a00) 00010000:00010000:2.0:1787882664.128277:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882664.128280:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df989 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128285:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df989 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128301:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128307:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df990 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128319:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df990 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128323:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882664.128326:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df990 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128333:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df990 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128340:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:2.0:1787882664.128343:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882664.128345:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df990 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.128351:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df990 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882664.128427:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:11552:x1874730541985280:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 Request processed in 498us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882664.128434:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 172 00000100:00100000:3.0:1787882664.132960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882664.132995:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541985536 00000100:00100000:3.0:1787882664.133003:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541985536 00000100:00100000:3.0:1787882664.133049:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 173 00000100:00100000:3.0:1787882664.133058:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:11552:x1874730541985536:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882664.133085:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882664.133102:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df997 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432b5 expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.133187:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df99e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.133200:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df99e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.133212:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df99e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882664.133222:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787882664.135968:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df99e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.135984:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df99e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.135993:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df99e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.136000:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882664.136005:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df99e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.136012:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df99e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.136032:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:3.0:1787882664.136045:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787882664.136050:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df99e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.136057:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df99e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.136112:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df997 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432b5 expref: 38 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.136124:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:3.0:1787882664.136126:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787882664.136132:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df997 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432b5 expref: 38 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.136144:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264600, rc 0) 00000100:00100000:3.0:1787882664.136218:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:11552:x1874730541985536:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 3159us (3263us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787882664.136227:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 173 00000100:00100000:0.0:1787882664.144052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882664.144509:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541985664 00000100:00100000:2.0:1787882664.144606:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541985664 00000100:00100000:2.0:1787882664.144663:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 174 00000100:00100000:2.0:1787882664.144675:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:11552:x1874730541985664:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787882664.144723:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787882664.144825:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:11552:x1874730541985664:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 152us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882664.144850:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 174 00000100:00100000:1.0:1787882664.151052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882664.151165:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541985920 00000100:00100000:3.0:1787882664.151174:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541985920 00000100:00100000:3.0:1787882664.151226:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 175 00000100:00100000:3.0:1787882664.151236:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:11552:x1874730541985920:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882664.151254:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882664.151257:0:6733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787882664.151291:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5df958 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432a7 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.151310:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:3.0:1787882664.151323:0:6733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787882664.151337:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df9ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432bc expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787882664.152126:0:6733:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787882664.152393:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df9b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.152407:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.152417:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.152464:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5df9ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432bc expref: 39 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.152479:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432bc expref: 38 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.152487:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa2a0727700) 00010000:00010000:3.0:1787882664.152490:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882664.152493:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264800, rc 0) 00000100:00100000:3.0:1787882664.152558:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11552:x1874730541985920:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1323us (1515us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787882664.152568:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 175 00000100:00100000:0.0:1787882664.174569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882664.174645:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541986176 00000100:00100000:3.0:1787882664.174654:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541986176 00000100:00100000:3.0:1787882664.174720:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 176 00000100:00100000:3.0:1787882664.174740:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11552:x1874730541986176:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787882664.174808:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882664.174833:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5df9b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432bc expref: 38 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.174862:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa2a0727700) 00010000:00010000:3.0:1787882664.174908:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787882664.175045:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175059:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175068:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175084:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df9c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe6297c24 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175091:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df9c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe6297c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175098:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df9c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe6297c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175338:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175346:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175352:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175357:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882664.175362:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175379:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175390:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:2.0:1787882664.175392:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882664.175396:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175401:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175410:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df9c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe6297c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175416:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df9c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe6297c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175436:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df9c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe6297c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175441:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791a400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882664.175444:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df9c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe6297c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175450:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df9c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe6297c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175457:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe6297c24 (ffff9fa285a00a00) 00010000:00010000:2.0:1787882664.175459:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882664.175462:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df9c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe6297c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.175478:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5df9c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe6297c24 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882664.175569:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:11552:x1874730541986176:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 840us (1017us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787882664.175577:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 176 00000100:00100000:0.0:1787882664.179431:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882664.179505:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541986304 00000100:00100000:2.0:1787882664.179529:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541986304 00000100:00100000:2.0:1787882664.179589:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 177 00000100:00100000:2.0:1787882664.179600:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:11552:x1874730541986304:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882664.179619:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882664.179642:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432c3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.179681:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ae00/0xf4731e8a7c5df9d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.179694:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ae00/0xf4731e8a7c5df9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.179715:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ae00/0xf4731e8a7c5df9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.179821:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432c3 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.179838:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ae00/0xf4731e8a7c5df9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432c3 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.179858:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:2.0:1787882664.179861:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787882664.179865:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791ae00, rc 0) 00000100:00100000:2.0:1787882664.179941:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11552:x1874730541986304:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 342us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882664.179949:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 177 00000100:00100000:1.0:1787882664.191573:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882664.191714:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541986560 00000100:00100000:2.0:1787882664.191724:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541986560 00000100:00100000:2.0:1787882664.191786:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 178 00000100:00100000:2.0:1787882664.191796:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11552:x1874730541986560:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787882664.191909:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.191926:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.191937:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787882664.192247:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1787882664.192257:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380341386359ns, next at 381341384207ns, rc = 0 00000004:00010000:2.0:1787882664.192345:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085e64be5 reply state 0000000079b542ff transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882664.192354:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787882664.192451:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+40:11552:x1874730541986560:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 655us (886us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787882664.192473:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 178 00010000:00010000:3.0:1787882664.194857:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.194901:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.194909:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.194915:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791be00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882664.194921:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.194928:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.194945:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:3.0:1787882664.194947:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787882664.194952:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.194959:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5df9dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882664.196753:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882664.198144:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541986688 00000100:00100000:0.0:1787882664.198156:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541986688 00000100:00100000:0.0:1787882664.198223:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 179 00000100:00100000:0.0:1787882664.198234:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+39:11552:x1874730541986688:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882664.198256:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882664.198276:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df9e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432ca expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.198331:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ca expref: 40 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.198346:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ca expref: 40 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.198365:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:0.0:1787882664.198369:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787882664.198372:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9a00, rc 0) 00000100:00100000:0.0:1787882664.198433:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+40:11552:x1874730541986688:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 201us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882664.198441:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 179 00000100:00100000:0.0:1787882664.205347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882664.205457:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541986816 00000100:00100000:2.0:1787882664.205465:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541986816 00000100:00100000:2.0:1787882664.205529:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:2.0:1787882664.205539:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541986816:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787882664.205728:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787882664.206131:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541986816:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 593us (791us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787882664.206139:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:2.0:1787882664.216241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882664.216333:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541987072 00000100:00100000:3.0:1787882664.216343:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541987072 00000100:00100000:3.0:1787882664.216398:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:3.0:1787882664.216409:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+40:11552:x1874730541987072:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787882664.216783:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:11552:x1874730541987072:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 374us (550us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787882664.216792:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:2.0:1787882664.222949:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882664.223116:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541987328 00000100:00100000:0.0:1787882664.223125:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541987328 00000100:00100000:0.0:1787882664.223289:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 180 00000100:00100000:0.0:1787882664.223301:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:11552:x1874730541987328:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787882664.223414:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:11552:x1874730541987328:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 114us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882664.223422:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 180 00000100:00100000:1.0:1787882664.226299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882664.227120:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541987456 00000100:00100000:2.0:1787882664.227130:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541987456 00000100:00100000:2.0:1787882664.227182:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 181 00000100:00100000:2.0:1787882664.227192:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:11552:x1874730541987456:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882664.227210:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882664.227228:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432d1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.227293:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5df9f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.227306:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5df9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.227316:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5df9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882664.227366:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882664.227382:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5df9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.227407:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5df9eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d1 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.227423:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5df9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d1 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.227432:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:2.0:1787882664.227435:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787882664.227438:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791b800, rc 0) 00000100:00100000:2.0:1787882664.227506:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+42:11552:x1874730541987456:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 315us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882664.227518:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 181 00000100:00100000:1.0:1787882664.231644:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882664.231778:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541987584 00000100:00100000:0.0:1787882664.231788:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541987584 00000100:00100000:0.0:1787882664.231841:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:0.0:1787882664.231851:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541987584:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882664.231886:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882664.231906:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000133b02a/0xf4731e8a7c5df9f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432d8 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787882664.231933:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90eca7, blocks: 0x1 00010000:00010000:0.0:1787882664.231966:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1787882664.231972:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882664.231982:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000133b02a/0xf4731e8a7c5df9f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d8 expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.231998:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000133b02a/0xf4731e8a7c5df9f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d8 expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.232010:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9800, rc 0) 00000100:00100000:0.0:1787882664.232084:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2357:x1874730541987584:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 234us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882664.232091:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:3.0:1787882664.235002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882664.236257:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541987840 00000100:00100000:0.0:1787882664.236270:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541987840 00000100:00100000:0.0:1787882664.236335:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 182 00000100:00100000:0.0:1787882664.236346:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+42:11552:x1874730541987840:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787882664.236451:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+42:11552:x1874730541987840:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 107us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882664.236459:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 182 00000100:00100000:3.0:1787882664.248614:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882664.248749:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541987968 00000100:00100000:1.0:1787882664.248758:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541987968 00000100:00100000:1.0:1787882664.248808:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:1.0:1787882664.248819:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:11552:x1874730541987968:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787882664.248838:0:9930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882664.248860:0:9930:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432df expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.248921:0:9930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000133b02a/0xf4731e8a7c5df9f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d8 expref: 9 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.248930:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882664.248945:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882664.248951:0:9930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 9 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.248999:0:9930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000133b02a/0xf4731e8a7c5df9f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d8 expref: 9 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.249013:0:9930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000133b02a/0xf4731e8a7c5df9f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d8 expref: 9 pid: 6709 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882664.249028:0:9930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9930:1874730564002304:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882664.249115:0:9930:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787882664.253728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882664.253763:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541988096 00000100:00100000:3.0:1787882664.253773:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541988096 00010000:00010000:3.0:1787882664.253814:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000133b02a/0xf4731e8a7c5df9f9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d8 expref: 10 pid: 6709 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882664.253849:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:3.0:1787882664.253858:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d852850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:2357:x1874730541988096:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882664.253891:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882664.253915:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000133b02a/0xf4731e8a7c5df9f9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d8 expref: 10 pid: 6709 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.253928:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000133b02a/0xf4731e8a7c5df9f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d8 expref: 10 pid: 6709 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.253952:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882664.254072:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882664.254095:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 10 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.254106:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 10 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.254145:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 10 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882664.254158:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1874730564002432:192.168.206.21@tcp:105: 00000100:00100000:3.0:1787882664.254226:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287de8300 going to sleep for 11 seconds 00010000:00010000:1.0:1787882664.255305:0:9930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000133b02a/0xf4731e8a7c5df9f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d8 expref: 10 pid: 6709 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882664.255322:0:9930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9930:1874730564002304:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882664.255349:0:9930:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 9 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.255362:0:9930:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6800, rc 0) 00000100:00100000:1.0:1787882664.255400:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:11552:x1874730541987968:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 6583us (6795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882664.255408:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:3.0:1787882664.263089:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1874730564002432:192.168.206.21@tcp:105: 00010000:00010000:3.0:1787882664.263115:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882664.263210:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d852850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2357:x1874730541988096:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 9351us (9489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882664.263221:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:2.0:1787882664.268212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882664.268516:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541988224 00000100:00100000:3.0:1787882664.268525:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541988224 00002000:00100000:3.0:1787882664.268580:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fa2bf3ffb80 x1874730541988224/t0(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:395/0 lens 504/0 e 0 to 0 dl 1787882675 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787882664.268592:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2bf3ffb80 with x1874730541988224 ext(0->8) 00002000:00010000:3.0:1787882664.268597:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2bf3ffb80 00000100:00100000:3.0:1787882664.268622:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:3.0:1787882664.268633:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2357:x1874730541988224:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787882664.269072:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:2357:x1874730541988224:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 Request processed in 440us (870us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787882664.269086:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00002000:00100000:3.0:1787882664.269094:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fa2bf3ffb80 x1874730541988224/t4294967314(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:395/0 lens 504/448 e 0 to 0 dl 1787882675 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787882664.269102:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2bf3ffb80 with x1874730541988224 ext(0->8) 00002000:00010000:3.0:1787882664.269106:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2bf3ffb80 00000100:00100000:2.0:1787882664.273378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882664.273455:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541988352 00000100:00100000:1.0:1787882664.273464:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541988352 00000100:00100000:1.0:1787882664.273519:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 183 00000100:00100000:1.0:1787882664.273537:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+42:11552:x1874730541988352:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787882664.300968:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+42:11552:x1874730541988352:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 Request processed in 27423us (27587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882664.300981:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 183 00000001:00080000:0.0:1787882664.301024:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:0.0:1787882664.301038:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1787882664.301043:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787882664.301085:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1787882664.301102:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1787882664.301217:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1787882664.301227:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787882664.301240:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564002560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787882664.301291:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882664.301344:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564002560 00000100:00100000:0.0:1787882664.301351:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564002560 00000100:00100000:0.0:1787882664.301398:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787882664.301406:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730564002560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787882664.301716:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787882664.301731:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787882663 00002000:00010000:0.0:1787882664.301734:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787882664.301736:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787882663 -> 1787882663 00002000:00010000:0.0:1787882664.301738:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787882664.301776:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730564002560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 370us (484us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787882664.301783:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787882664.301800:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787882664.302818:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2b622f100/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787882664.302829:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b622f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564002560:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1787882664.303899:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1787882664.303917:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1787882664.305802:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882664.305900:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541988480 00000100:00100000:1.0:1787882664.305912:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541988480 00000100:00100000:1.0:1787882664.305970:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:1.0:1787882664.305981:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:2356:x1874730541988480:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787882664.338179:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1787882664.338207:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1787882664.338221:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1787882664.339157:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730541988480:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 Request processed in 33171us (33356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882664.339169:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:3.0:1787882664.341936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882664.342371:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541988736 00000100:00100000:1.0:1787882664.342380:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541988736 00000100:00100000:1.0:1787882664.342434:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 184 00000100:00100000:1.0:1787882664.342444:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:11552:x1874730541988736:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787882664.342512:0:6733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882664.342537:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5df9f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432d1 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.342556:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:1.0:1787882664.342572:0:6733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787882664.342603:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5dfa07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.342616:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5dfa07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.342626:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5dfa07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787882664.342931:0:6733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000574a109d reply state 000000004e29123d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5dfa07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882664.342964:0:6733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787882664.343057:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:11552:x1874730541988736:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 614us (1129us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787882664.343065:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 184 00010000:00010000:3.0:1787882664.344846:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5dfa07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.344862:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5dfa07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.344894:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5dfa07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.344901:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882664.344906:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5dfa07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.344914:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5dfa07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.344931:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:3.0:1787882664.344934:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882664.344938:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5dfa07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.344945:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7200/0xf4731e8a7c5dfa07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882664.346859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882664.347050:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541988864 00000100:00100000:2.0:1787882664.347060:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541988864 00000100:00100000:2.0:1787882664.347113:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:2.0:1787882664.347124:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541988864:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787882664.347347:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787882664.347351:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787882663 -> 1787882662 00002000:00010000:2.0:1787882664.347353:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787882660 00002000:00010000:2.0:1787882664.347367:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787882663 -> 1787882662 00002000:00010000:2.0:1787882664.347369:0:6710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787882664.347427:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2357:x1874730541988864:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 305us (576us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787882664.347436:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:0.0:1787882664.351172:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882664.351416:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541989120 00000100:00100000:2.0:1787882664.351426:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541989120 00000100:00100000:2.0:1787882664.351492:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 185 00000100:00100000:2.0:1787882664.351503:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:11552:x1874730541989120:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787882664.351678:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.351694:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ae00/0xf4731e8a7c5df9d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432c3 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.351714:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.351746:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ae00/0xf4731e8a7c5df9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432c3 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.351759:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ae00/0xf4731e8a7c5df9d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432c3 expref: 18 pid: 5843 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882664.351772:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730564002688:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882664.352030:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157600 going to sleep for 11 seconds 00000100:00100000:2.0:1787882664.353903:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730564002688:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882664.353945:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882664.354192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882664.354421:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541989248 00000100:00100000:3.0:1787882664.354428:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541989248 00010000:00010000:3.0:1787882664.354462:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ae00/0xf4731e8a7c5df9d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432c3 expref: 19 pid: 5843 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882664.354499:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:3.0:1787882664.354510:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:2357:x1874730541989248:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882664.354525:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882664.354531:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ae00/0xf4731e8a7c5df9d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432c3 expref: 19 pid: 5843 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.354544:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ae00/0xf4731e8a7c5df9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432c3 expref: 19 pid: 5843 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.354566:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ae00/0xf4731e8a7c5df9d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432c3 expref: 19 pid: 5843 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.354581:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:3.0:1787882664.354586:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.354595:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.354603:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.354650:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787882664.354673:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.354680:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882664.354713:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:2357:x1874730541989248:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 205us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882664.354720:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 69 00010000:00010000:2.0:1787882664.354720:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.354727:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.354733:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.354739:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882664.354743:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.354750:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.354760:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:2.0:1787882664.354763:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787882664.354767:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.354773:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b800/0xf4731e8a7c5dfa0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882664.356267:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:11552:x1874730541989120:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 Request processed in 4756us (5094us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787882664.356281:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 185 00000100:00100000:0.0:1787882664.364276:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882664.364499:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541989376 00000100:00100000:1.0:1787882664.364509:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541989376 00000100:00100000:1.0:1787882664.364567:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:1.0:1787882664.364577:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730541989376:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787882664.364618:0:6709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.364638:0:6709:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 8 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.364646:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882664.364651:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787882664.364656:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.364689:0:6709:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 8 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.364714:0:6709:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 8 pid: 9930 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882664.364729:0:6709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1874730564002816:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882664.364820:0:6709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29290d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787882664.368627:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882664.368769:0:6709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6709:1874730564002816:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882664.368790:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541989504 00010000:00010000:1.0:1787882664.368794:0:6709:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882664.368798:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541989504 00010000:00010000:3.0:1787882664.368830:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 9 pid: 9930 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882664.368914:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:2.0:1787882664.369653:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2356:x1874730541989504:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882664.369671:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882664.369707:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 9 pid: 9930 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.369722:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 9 pid: 9930 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.369744:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfa00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432df expref: 9 pid: 9930 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.369758:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882664.369762:0:8466:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882664.369767:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.369776:0:8466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.369851:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882664.369939:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730541989504:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1014us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882664.369962:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 70 00010000:00010000:1.0:1787882664.371382:0:6709:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.371399:0:6709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.371543:0:6709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.371553:0:6709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.371677:0:6709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.371686:0:6709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882664.371690:0:6709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.371711:0:6709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.371746:0:6709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.371754:0:6709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e2b050/0xf4731e8a7c5dfa15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882664.372064:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730541989376:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 Request processed in 7483us (7792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882664.372074:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:0.0:1787882664.375760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882664.375843:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541989760 00000100:00100000:1.0:1787882664.375855:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541989760 00000100:00100000:1.0:1787882664.376168:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 186 00000100:00100000:1.0:1787882664.376179:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+17:11552:x1874730541989760:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787882664.376260:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.376277:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.376288:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.376494:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.376505:0:6733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df9e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ca expref: 18 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.376528:0:6733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.376559:0:6733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ca expref: 18 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.376571:0:6733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df9e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ca expref: 18 pid: 6733 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882664.376586:0:6733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730564002944:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882664.376778:0:6733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29290d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787882664.380945:0:6733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730564002944:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882664.380974:0:6733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882664.381820:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882664.382024:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541989888 00000100:00100000:1.0:1787882664.382032:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541989888 00010000:00010000:1.0:1787882664.382070:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df9e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ca expref: 19 pid: 6733 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882664.382103:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00100000:1.0:1787882664.382113:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:2357:x1874730541989888:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882664.382130:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882664.382137:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df9e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ca expref: 19 pid: 6733 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.382167:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ca expref: 19 pid: 6733 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.382187:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5df9e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ca expref: 19 pid: 6733 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.382202:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:1.0:1787882664.382208:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.382217:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.382224:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.382252:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787882664.382278:0:6733:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.382285:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882664.382305:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:2357:x1874730541989888:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 193us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882664.382311:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 71 00000001:00080000:0.0:1787882664.384259:0:6733:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1787882664.384752:0:6733:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787882664.384800:0:6733:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787882664.386100:0:6733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b622d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6733:1874730564003072:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787882664.388331:0:6733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882664.388374:0:6733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa282b4ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882664.388975:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564003072 00000100:00100000:0.0:1787882664.388985:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564003072 00000100:00100000:0.0:1787882664.389046:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787882664.389056:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6733:x1874730564003072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787882664.389166:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6733:x1874730564003072:12345-0@lo:1000:mdt00_003.0 Request processed in 112us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882664.389174:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787882664.389315:0:6733:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787882664.389321:0:6733:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2b622f100, transno 4294967315 00000100:00100000:2.0:1787882664.389339:0:6733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b622d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6733:1874730564003072:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787882664.390012:0:6733:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787882664.390093:0:6733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6733:1874730564003200:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787882664.390136:0:6733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882664.390155:0:6733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29daf0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787882664.390632:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564003200 00000100:00100000:1.0:1787882664.390639:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564003200 00000100:00100000:1.0:1787882664.390672:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787882664.390680:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6733:x1874730564003200:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787882664.390894:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6733:x1874730564003200:12345-0@lo:1000:mdt00_003.0 Request processed in 214us (757us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787882664.390911:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787882664.391090:0:6733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6733:1874730564003200:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787882664.391125:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391135:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391143:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391149:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882664.391154:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391161:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391176:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa285a00800) 00010000:00010000:2.0:1787882664.391180:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787882664.391185:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391197:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6000/0xf4731e8a7c5dfa23 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391225:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df95f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391232:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df95f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391237:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df95f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391242:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791a800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882664.391245:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df95f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391251:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df95f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391259:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:2.0:1787882664.391262:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787882664.391264:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df95f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391269:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5df95f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391286:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391299:0:6733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ae expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391313:0:6733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391339:0:6733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ae expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882664.391351:0:6733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ae expref: 21 pid: 5844 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882664.391363:0:6733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730564003328:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882664.391441:0:6733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29daf0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787882664.395613:0:6733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730564003328:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882664.395641:0:6733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882664.397409:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882664.397494:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541990016 00000100:00100000:0.0:1787882664.397504:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541990016 00010000:00010000:0.0:1787882664.397543:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ae expref: 22 pid: 5844 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882664.397582:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:0.0:1787882664.397593:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:2356:x1874730541990016:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882664.397608:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882664.397615:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ae expref: 22 pid: 5844 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.397627:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ae expref: 22 pid: 5844 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.397647:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5df97b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ae expref: 22 pid: 5844 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.397662:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:0.0:1787882664.397668:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.397704:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.397713:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882664.397746:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882664.397797:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:2356:x1874730541990016:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 206us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882664.397804:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 72 00010000:00010000:1.0:1787882664.397998:0:6733:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398007:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398020:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398027:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398033:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398039:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791bc00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882664.398043:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398051:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398060:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:1.0:1787882664.398063:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882664.398066:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398072:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfa2a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398082:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398095:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398100:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398105:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882664.398107:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398112:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398119:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00c00) 00010000:00010000:1.0:1787882664.398121:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787882664.398124:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.398129:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882664.398330:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:11552:x1874730541989760:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 22153us (22578us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1787882664.398338:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 186 00000020:00080000:1.0:1787882664.398341:0:6733:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787882664.398922:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882664.398927:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882664.399387:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787882664.399397:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787882664.418634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882664.418726:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541990272 00000100:00100000:0.0:1787882664.418736:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541990272 00000100:00100000:0.0:1787882664.418794:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:0.0:1787882664.418805:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa288323850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:11552:x1874730541990272:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787882664.419735:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787882664.419840:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787882664.420023:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.420051:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.420063:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.420070:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa31 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.420077:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa31 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.420083:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882664.420139:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787882664.420236:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa288323850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:11552:x1874730541990272:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 1430us (1608us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787882664.420246:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00000020:00080000:1.0:1787882664.420251:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787882664.420371:0:11677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882664.420378:0:11677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.420387:0:11677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882664.420391:0:11677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.420397:0:11677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.420410:0:11677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fa283291800) 00010000:00010000:3.0:1787882664.420412:0:11677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787882664.420481:0:11677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa31 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.420488:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfa31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882664.420504:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882664.420719:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882664.420722:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882665.066117:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787882665.947352:0:12574:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787882665.947360:0:12574:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787882665.947396:0:12574:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787882665.947403:0:12574:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787882666.089316:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882666.089424:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541990528 00000100:00100000:1.0:1787882666.089437:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541990528 00000100:00100000:1.0:1787882666.089515:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 187 00000100:00100000:1.0:1787882666.089526:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:11569:x1874730541990528:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1787882666.089551:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882666.089571:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5dfa38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432e6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.089854:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7600/0xf4731e8a7c5dfa3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.089901:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7600/0xf4731e8a7c5dfa3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.089915:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7600/0xf4731e8a7c5dfa3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882666.089928:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787882666.090309:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5dfa38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432e6 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.090328:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7600/0xf4731e8a7c5dfa3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432e6 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.090338:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:1.0:1787882666.090342:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787882666.090346:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa7600, rc 0) 00000100:00100000:1.0:1787882666.090411:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:11569:x1874730541990528:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 885us (1104us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787882666.090420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 187 00000100:00080000:0.0:1787882666.091492:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882666.101511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:0.0:1787882666.101743:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882666.101920:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541990656 00000100:00100000:2.0:1787882666.101931:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541990656 00000100:00100000:2.0:1787882666.102134:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 188 00000100:00100000:2.0:1787882666.102147:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:11569:x1874730541990656:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:2.0:1787882666.102225:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfa4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102243:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfa4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102265:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfa4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102282:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5dfa54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102289:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5dfa54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102294:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5dfa54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102599:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102608:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102616:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787882666.102652:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102664:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfa4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102670:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfa4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102677:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfa4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102706:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791be00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882666.102711:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfa4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102718:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfa4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102731:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:2.0:1787882666.102734:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882666.102738:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfa4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102744:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfa4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102756:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5dfa54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102762:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5dfa54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102768:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5dfa54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102773:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791a000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882666.102775:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5dfa54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102781:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5dfa54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102802:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa285a00800) 00010000:00010000:2.0:1787882666.102804:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882666.102807:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5dfa54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102813:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a000/0xf4731e8a7c5dfa54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102829:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102835:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102840:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102845:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791ba00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882666.102847:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102853:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102860:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa285a00a00) 00010000:00010000:2.0:1787882666.102862:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882666.102864:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.102919:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882666.103483:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:11569:x1874730541990656:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 1334us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882666.103493:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 188 00000100:00100000:1.0:1787882666.189169:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882666.189207:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541990912 00000100:00100000:1.0:1787882666.189218:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541990912 00000100:00100000:1.0:1787882666.189274:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 189 00000100:00100000:1.0:1787882666.189285:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+24:11572:x1874730541990912:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1787882666.189308:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882666.189328:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5dfa62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.189494:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfa69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.189510:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfa69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.189520:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfa69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.189533:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.189539:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.189545:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.191599:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfa77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.191618:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfa77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.191628:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfa77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882666.191638:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787882666.193672:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfa69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193698:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfa69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193718:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfa69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193725:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882666.193730:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfa69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193738:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfa69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193754:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:1.0:1787882666.193757:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882666.193761:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfa69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193768:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfa69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193780:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193787:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193793:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193797:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882666.193800:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193816:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193837:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa283291100) 00010000:00010000:1.0:1787882666.193840:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882666.193843:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.193849:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.195753:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5dfa62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ed expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.195781:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfa77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ed expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.195790:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:1.0:1787882666.195793:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787882666.195796:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6e00, rc 0) 00000100:00100000:1.0:1787882666.198013:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:11572:x1874730541990912:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 8718us (8841us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787882666.198026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 189 00000100:00100000:0.0:1787882666.202126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882666.202817:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541991040 00000100:00100000:2.0:1787882666.202827:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541991040 00000100:00100000:2.0:1787882666.202906:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 190 00000100:00100000:2.0:1787882666.202917:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:11572:x1874730541991040:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:2.0:1787882666.203120:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.203136:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.203147:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.203172:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.203178:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.203184:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.203190:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791ba00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882666.203194:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.203200:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.203227:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:2.0:1787882666.203230:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787882666.203234:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.203240:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791ba00/0xf4731e8a7c5dfa85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882666.203317:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:11572:x1874730541991040:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 401us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882666.203325:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 190 00000100:00100000:2.0:1787882666.214226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882666.214330:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541991296 00000100:00100000:2.0:1787882666.214339:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541991296 00000100:00100000:2.0:1787882666.214389:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:2.0:1787882666.214400:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:11572:x1874730541991296:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1787882666.214631:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:11572:x1874730541991296:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 232us (413us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787882666.214639:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:0.0:1787882666.261978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882666.262121:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541991552 00000100:00100000:1.0:1787882666.262131:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541991552 00000100:00100000:1.0:1787882666.262190:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 191 00000100:00100000:1.0:1787882666.262201:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:11098:x1874730541991552:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1787882666.262240:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882666.262260:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5dfa8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432f4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.262359:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.262374:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfa77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ed expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.262382:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.262414:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfa77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ed expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.262427:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfa77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ed expref: 28 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882666.262440:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730564003456:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882666.262548:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787882666.271915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882666.271998:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541991680 00000100:00100000:3.0:1787882666.272008:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541991680 00010000:00010000:3.0:1787882666.272046:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfa77 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ed expref: 29 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882666.272079:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:3.0:1787882666.272089:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:2357:x1874730541991680:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882666.272104:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882666.272111:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfa77 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ed expref: 29 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.272130:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfa77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ed expref: 29 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.272150:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:3.0:1787882666.272155:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.272164:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.272170:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.272199:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882666.272254:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:2357:x1874730541991680:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 166us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882666.272262:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 73 00010000:00010000:1.0:1787882666.272799:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfa77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432ed expref: 28 pid: 5844 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882666.272815:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730564003456:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882666.272834:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.272853:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.272859:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882666.272916:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787882666.273056:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5dfa8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432f4 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.273071:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432f4 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.273078:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:1.0:1787882666.273081:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787882666.273083:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa7800, rc 0) 00000100:00100000:1.0:1787882666.273117:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:11098:x1874730541991552:12345-192.168.206.21@tcp:101:bash.0 Request processed in 10918us (11164us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787882666.273124:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 191 00000100:00100000:2.0:1787882666.277263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882666.277346:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541991936 00000100:00100000:3.0:1787882666.277356:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541991936 00000100:00100000:3.0:1787882666.277410:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 192 00000100:00100000:3.0:1787882666.277421:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:11098:x1874730541991936:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:3.0:1787882666.277678:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfaa1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.277702:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.277713:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787882666.277765:0:6733:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787882666.277790:0:6733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019db4c77 reply state 00000000dfb22abc transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882666.277799:0:6733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787882666.277847:0:6733:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787882666.282118:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564003584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882666.282196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882666.282288:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564003584 00000100:00100000:1.0:1787882666.282296:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564003584 00000100:00100000:1.0:1787882666.282362:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787882666.282372:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa286679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564003584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882666.282404:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882666.282452:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa286679050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564003584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882666.282471:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787882666.282696:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787882666.282702:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1787882666.282719:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2af849500, transno 4294967307 00000100:00100000:1.0:1787882666.282737:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564003584:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787882666.283242:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787882666.284021:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730564003840:0@lo:400:kworker.0 00000100:00100000:3.0:1787882666.284076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882666.284120:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787882666.284125:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730564003968:0@lo:400:kworker.0 00000100:00100000:3.0:1787882666.284150:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882666.284180:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564003840 00000100:00100000:3.0:1787882666.284186:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564003840 00000100:00100000:3.0:1787882666.284218:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564003968 00000100:00100000:3.0:1787882666.284221:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564003968 00000100:00100000:3.0:1787882666.284245:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787882666.284253:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730564003840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882666.284296:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730564003840:12345-0@lo:400:kworker.0 Request processed in 44us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882666.284302:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787882666.284319:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787882666.284324:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730564003968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882666.284348:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730564003968:12345-0@lo:400:kworker.0 Request processed in 24us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882666.284354:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1787882666.284371:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882666.284397:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730564003968:0@lo:400:kworker.0 00000100:00100000:3.0:1787882666.284408:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1525180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730564003840:0@lo:400:kworker.0 00000100:00100000:0.0:1787882666.284489:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730564003712:0@lo:400:kworker.0 00000100:00100000:0.0:1787882666.284523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882666.284562:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bfaf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564004224:0@lo:400:kworker.0 00000100:00100000:0.0:1787882666.284589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882666.284615:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787882666.284621:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730564004096:0@lo:400:kworker.0 00000100:00100000:0.0:1787882666.284644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882666.284668:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564004096 00000100:00100000:0.0:1787882666.284672:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564004096 00000100:00100000:0.0:1787882666.284729:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787882666.284736:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730564004096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882666.284771:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730564004096:12345-0@lo:400:kworker.0 Request processed in 36us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882666.284777:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1787882666.284791:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882666.284807:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730564004096:0@lo:400:kworker.0 00000100:00100000:1.0:1787882666.285017:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564004224 00000100:00100000:1.0:1787882666.285022:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564004224 00000100:00100000:1.0:1787882666.285056:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787882666.285064:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3306:x1874730564004224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882666.285106:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3306:x1874730564004224:12345-0@lo:400:kworker.0 Request processed in 44us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882666.285112:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787882666.285142:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bfaf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564004224:0@lo:400:kworker.0 00000100:00100000:2.0:1787882666.287261:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:11098:x1874730541991936:12345-192.168.206.21@tcp:36:bash.0 Request processed in 9833us (9998us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787882666.287273:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 192 00000020:00080000:2.0:1787882666.287278:0:6733:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:0.0:1787882666.288076:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882666.288472:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564003712 00000100:00100000:3.0:1787882666.288483:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564003712 00000100:00100000:3.0:1787882666.288981:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1787882666.288993:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730564003712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882666.289069:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3306:x1874730564003712:12345-0@lo:400:kworker.0 Request processed in 79us (4544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882666.289092:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787882666.289626:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3306:1874730564003712:0@lo:400:kworker.0 00010000:00010000:3.0:1787882666.291998:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfaa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.292014:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfaa1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.292022:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfaa1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.292028:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882666.292032:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfaa1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.292040:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfaa1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.292055:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:3.0:1787882666.292059:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882666.292063:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfaa1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.292070:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfaa1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882666.294379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882666.294705:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541992064 00000100:00100000:0.0:1787882666.294716:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541992064 00000100:00100000:0.0:1787882666.294766:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 193 00000100:00100000:0.0:1787882666.294777:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:11098:x1874730541992064:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1787882666.294800:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882666.294819:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfaa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8432fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.294909:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfaa8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432fb expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.294924:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfaa8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432fb expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.294945:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:0.0:1787882666.294976:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787882666.294981:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9400, rc 0) 00000100:00100000:0.0:1787882666.295094:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:11098:x1874730541992064:12345-192.168.206.21@tcp:101:bash.0 Request processed in 318us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882666.295101:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 193 00000100:00100000:0.0:1787882666.303763:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882666.304101:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541992192 00000100:00100000:2.0:1787882666.304124:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541992192 00000100:00100000:2.0:1787882666.304250:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:2.0:1787882666.304262:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:11098:x1874730541992192:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1787882666.304278:0:6710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882666.304299:0:6710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5dfaaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843302 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882666.304325:0:6710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a90eca6, atime: 0x6a90eca4, ctime: 0x6a90eca6, blocks: 0xb 00010000:00010000:2.0:1787882666.304356:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1787882666.304361:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882666.304369:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5dfaaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843302 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.304386:0:6710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5dfaaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843302 expref: 8 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.304398:0:6710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791be00, rc 0) 00000100:00100000:2.0:1787882666.304472:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:11098:x1874730541992192:12345-192.168.206.21@tcp:101:bash.0 Request processed in 212us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882666.304480:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00080000:0.0:1787882666.304832:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787882666.310713:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882666.310810:0:6716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541992320 00000100:00100000:3.0:1787882666.310821:0:6716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541992320 00002000:00010000:3.0:1787882666.310861:0:6716:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1787882666.310865:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2c15ab480 with x1874730541992320 ext(0->18446744073709551615) 00002000:00010000:3.0:1787882666.310911:0:6716:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2c15ab480. 00000100:00100000:3.0:1787882666.310945:0:6716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:3.0:1787882666.310984:0:6716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730541992320:12345-192.168.206.21@tcp:10:bash.0 00002000:00010000:3.0:1787882666.311224:0:6716:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787882666.311227:0:6716:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787882662 -> 1787882665 00002000:00010000:3.0:1787882666.311230:0:6716:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787882660 -> 1787882660 00002000:00010000:3.0:1787882666.311233:0:6716:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787882662 -> 1787882665 00002000:00010000:3.0:1787882666.311235:0:6716:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787882666.311284:0:6716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2356:x1874730541992320:12345-192.168.206.21@tcp:10:bash.0 Request processed in 302us (580us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787882666.311291:0:6716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00002000:00010000:3.0:1787882666.311295:0:6716:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1787882666.311297:0:6716:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2c15ab480 with x1874730541992320 ext(0->18446744073709551615) 00002000:00010000:3.0:1787882666.311301:0:6716:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2c15ab480. 00000100:00100000:3.0:1787882666.414295:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882666.416517:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541992448 00000100:00100000:1.0:1787882666.416532:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541992448 00000100:00100000:1.0:1787882666.416609:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 194 00000100:00100000:1.0:1787882666.416620:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c158a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:11586:x1874730541992448:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:1.0:1787882666.416699:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfab6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.416715:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.416727:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.416740:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfabd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.416759:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.416766:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417038:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417047:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417053:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787882666.417102:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417112:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfab6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417119:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfab6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417125:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfab6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417130:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882666.417134:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfab6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417140:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfab6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417160:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:1.0:1787882666.417163:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882666.417168:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfab6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417173:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfab6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417186:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417191:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfabd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417197:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfabd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417202:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882666.417205:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfabd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417210:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfabd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417218:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa283291100) 00010000:00010000:1.0:1787882666.417220:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882666.417222:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfabd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417228:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfabd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417251:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417256:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfac4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417261:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417267:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882666.417269:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417274:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfac4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417280:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:1.0:1787882666.417283:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882666.417285:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfac4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.417291:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfac4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882666.417380:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c158a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:11586:x1874730541992448:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 760us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882666.417387:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 194 00000100:00100000:0.0:1787882666.487370:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882666.487576:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541992704 00000100:00100000:3.0:1787882666.487586:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541992704 00000100:00100000:3.0:1787882666.487647:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 195 00000100:00100000:3.0:1787882666.487659:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+32:11589:x1874730541992704:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882666.487680:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882666.487713:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfacb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843309 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.487787:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfad2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.487801:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfad2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.487832:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfad2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.487847:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfad9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.487854:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.487859:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488226:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfae0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488235:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488242:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882666.488251:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787882666.488343:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfad2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488351:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfad2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488553:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfad2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488559:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882666.488570:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfad2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488577:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfad2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488589:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:3.0:1787882666.488592:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882666.488596:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfad2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488602:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfad2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488615:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfad9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488621:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfad9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488627:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488631:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882666.488634:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfad9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488639:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfad9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488646:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa2a0727600) 00010000:00010000:3.0:1787882666.488648:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882666.488657:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfad9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488662:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfad9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488716:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfacb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843309 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488729:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843309 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.488736:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:3.0:1787882666.488738:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787882666.488740:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265600, rc 0) 00000100:00100000:3.0:1787882666.488916:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:11589:x1874730541992704:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1214us (1520us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787882666.488924:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 195 00000100:00100000:3.0:1787882666.493100:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882666.493277:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541992832 00000100:00100000:1.0:1787882666.493289:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541992832 00000100:00100000:1.0:1787882666.493345:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 196 00000100:00100000:1.0:1787882666.493381:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:11589:x1874730541992832:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:1.0:1787882666.493443:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.493470:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432f4 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.493481:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.493516:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432f4 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.493530:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432f4 expref: 34 pid: 5845 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882666.493545:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730564004352:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882666.493641:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787882666.498185:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730564004352:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882666.498213:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882666.499468:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882666.499559:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541993088 00000100:00100000:2.0:1787882666.499567:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541993088 00000100:00100000:2.0:1787882666.499627:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:2.0:1787882666.499637:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:5609:x1874730541993088:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787882666.499974:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:5609:x1874730541993088:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 337us (515us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787882666.499998:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:2.0:1787882666.503226:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882666.503311:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541993216 00000100:00100000:0.0:1787882666.503322:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541993216 00010000:00010000:0.0:1787882666.503373:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432f4 expref: 36 pid: 5845 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882666.503413:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:0.0:1787882666.503424:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:2357:x1874730541993216:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882666.503437:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882666.503444:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432f4 expref: 36 pid: 5845 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.503457:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432f4 expref: 36 pid: 5845 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.503488:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5dfa93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432f4 expref: 36 pid: 5845 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.503505:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:0.0:1787882666.503510:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.503537:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.503545:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.503584:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882666.503644:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:2357:x1874730541993216:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 221us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882666.503652:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 74 00010000:00010000:1.0:1787882666.503980:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.503988:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.504019:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.504032:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.504038:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.504044:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882666.504049:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.504056:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.504067:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:1.0:1787882666.504070:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787882666.504074:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.504080:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5dfaee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882666.504140:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:11589:x1874730541992832:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 10761us (11048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882666.504147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 196 00000100:00100000:2.0:1787882666.508129:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882666.508370:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541993472 00000100:00100000:3.0:1787882666.508381:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541993472 00000100:00100000:3.0:1787882666.508436:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:3.0:1787882666.508447:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+34:11589:x1874730541993472:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1787882666.508702:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:11589:x1874730541993472:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 256us (583us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787882666.508710:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:3.0:1787882666.659680:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882666.659893:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541993728 00000100:00100000:0.0:1787882666.659904:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541993728 00000100:00100000:0.0:1787882666.659965:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 197 00000100:00100000:0.0:1787882666.659975:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+35:11600:x1874730541993728:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:0.0:1787882666.659998:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882666.660018:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5dfaf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843310 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660088:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfafc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660102:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfafc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660113:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfafc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660127:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660158:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660166:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660475:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660485:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660492:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882666.660502:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787882666.660607:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfafc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660614:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfafc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660621:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfafc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660627:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882666.660632:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfafc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660640:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfafc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660663:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:0.0:1787882666.660667:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882666.660671:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfafc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660678:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfafc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660703:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660710:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660715:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660720:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882666.660723:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660729:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660737:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa289160200) 00010000:00010000:0.0:1787882666.660739:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882666.660742:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660748:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660799:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8000/0xf4731e8a7c5dfaf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843310 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660812:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843310 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.660819:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:0.0:1787882666.660821:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882666.660824:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8e00, rc 0) 00000100:00100000:0.0:1787882666.660940:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:11600:x1874730541993728:12345-192.168.206.21@tcp:101:cat.0 Request processed in 965us (1271us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1787882666.660947:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 197 00000100:00100000:0.0:1787882666.674810:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882666.674892:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541993984 00000100:00100000:3.0:1787882666.674902:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541993984 00000100:00100000:3.0:1787882666.674960:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:3.0:1787882666.674971:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:11600:x1874730541993984:12345-192.168.206.21@tcp:35:cat.0 00000100:00100000:3.0:1787882666.675210:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11600:x1874730541993984:12345-192.168.206.21@tcp:35:cat.0 Request processed in 241us (409us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787882666.675218:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:2.0:1787882666.717431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882666.718244:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541994240 00000100:00100000:0.0:1787882666.718255:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541994240 00000100:00100000:0.0:1787882666.718327:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 198 00000100:00100000:0.0:1787882666.718338:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11601:x1874730541994240:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1787882666.718394:0:6733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787882666.718420:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843310 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.718440:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfae0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843309 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.718452:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfaa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432fb expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.718489:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa283291700) 00010000:00010000:0.0:1787882666.718499:0:6733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787882666.718520:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb18 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.718534:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.718544:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.718941:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfb1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.718951:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfb1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.718958:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfb1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.719644:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb26 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.719655:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.719664:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787882666.722935:0:6733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787882666.722950:0:6733:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382872079208ns, next at 383872076251ns, rc = 0 00010000:00010000:0.0:1787882666.723042:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfb2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723059:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfb2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723070:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfb2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723078:0:6733:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfb2d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723084:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfb2d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723090:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfb2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723114:0:6733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882666.723134:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723153:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb26 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723160:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723165:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882666.723169:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723177:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb26 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723196:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa289160c00) 00010000:00010000:0.0:1787882666.723199:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787882666.723204:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb26 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723210:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb26 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723230:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723237:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb18 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723242:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb18 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723247:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882666.723249:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb18 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723254:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb18 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723262:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:0.0:1787882666.723264:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882666.723266:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb18 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.723272:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb18 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787882666.723293:0:6733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000163cb4c1 reply state 0000000061c4f87d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfb1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882666.723301:0:6733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787882666.723401:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+37:11601:x1874730541994240:12345-192.168.206.21@tcp:36:rm.0 Request processed in 5061us (5977us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787882666.723410:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 198 00010000:00010000:2.0:1787882666.728229:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882666.728242:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfb2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.728254:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882666.728258:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfb2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.728268:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfb2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.728285:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fa289160c00) 00010000:00010000:2.0:1787882666.728288:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787882666.728293:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfb2d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.728299:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfb2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.728322:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882666.728324:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882666.728326:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882666.739093:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfb1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.739111:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfb1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.739119:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfb1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.739125:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882666.739130:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfb1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.739149:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfb1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.739166:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa289160200) 00010000:00010000:3.0:1787882666.739169:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882666.739174:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfb1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.739180:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfb1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882666.789161:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882666.789863:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541994496 00000100:00100000:0.0:1787882666.789907:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541994496 00000100:00100000:0.0:1787882666.789968:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 199 00000100:00100000:0.0:1787882666.789980:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+36:11607:x1874730541994496:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1787882666.790003:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882666.790023:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843317 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.790145:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb3b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.790160:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb3b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.790170:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb3b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.790186:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfb42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.790193:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfb42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.790217:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfb42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787882666.791041:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787882666.791204:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.791216:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.791225:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.791258:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb3b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.791265:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb3b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.791271:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb3b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.791277:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882666.791282:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb3b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.791290:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb3b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.791301:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:0.0:1787882666.791304:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882666.792453:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb3b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882666.792665:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8200/0xf4731e8a7c5dfb3b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787882666.792693:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024e39565 reply state 0000000049b6810c transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfb42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882666.792702:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787882666.792915:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfb34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843317 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.792952:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843317 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.792961:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa289160c00) 00010000:00010000:2.0:1787882666.792964:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787882666.792966:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8e00, rc 0) 00000100:00100000:2.0:1787882666.793092:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+39:11607:x1874730541994496:12345-192.168.206.21@tcp:101:bash.0 Request processed in 3113us (3938us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787882666.793102:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 199 00000100:00100000:1.0:1787882666.794145:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564004480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787882666.794202:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882666.794308:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564004480 00000100:00100000:0.0:1787882666.794327:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564004480 00000100:00100000:0.0:1787882666.794372:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787882666.794381:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730564004480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787882666.794410:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882666.794451:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730564004480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882666.794469:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787882666.794799:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564004480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882666.803483:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882666.805791:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541994624 00000100:00100000:2.0:1787882666.805804:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541994624 00000100:00100000:2.0:1787882666.805893:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:2.0:1787882666.805904:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b727c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730541994624:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1787882666.805921:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882666.805940:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c92a930/0xf4731e8a7c5dfb57 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84331e expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882666.805967:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787882666.805986:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1787882666.805991:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882666.806001:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c92a930/0xf4731e8a7c5dfb57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84331e expref: 6 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.806020:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007c92a930/0xf4731e8a7c5dfb57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84331e expref: 6 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882666.806051:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a600, rc 0) 00000100:00100000:2.0:1787882666.806108:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b727c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541994624:12345-192.168.206.21@tcp:101:bash.0 Request processed in 205us (2634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882666.806115:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00080000:3.0:1787882666.806158:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787882666.806734:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfb42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.806751:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfb42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.806757:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfb42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.806762:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882666.806767:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfb42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.806774:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfb42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.806787:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa289160200) 00010000:00010000:1.0:1787882666.806790:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882666.806793:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfb42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.806799:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfb42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882666.810349:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882666.810400:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541994752 00000100:00100000:1.0:1787882666.810410:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541994752 00000100:00100000:1.0:1787882666.810481:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:1.0:1787882666.810493:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:11607:x1874730541994752:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1787882666.810511:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882666.810529:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843325 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.810580:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007c92a930/0xf4731e8a7c5dfb57 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84331e expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.810590:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882666.810595:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882666.810601:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.810636:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007c92a930/0xf4731e8a7c5dfb57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84331e expref: 7 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.810649:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007c92a930/0xf4731e8a7c5dfb57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84331e expref: 7 pid: 6709 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882666.810662:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6711:1874730564004608:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882666.810762:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787882666.814980:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6711:1874730564004608:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882666.815014:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 7 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882666.815034:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa7a00, rc 0) 00000100:00100000:1.0:1787882666.815091:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:11607:x1874730541994752:12345-192.168.206.21@tcp:101:bash.0 Request processed in 4599us (4750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882666.815099:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:2.0:1787882666.817217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882666.817525:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541994880 00000100:00100000:3.0:1787882666.817534:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541994880 00010000:00010000:3.0:1787882666.817578:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007c92a930/0xf4731e8a7c5dfb57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84331e expref: 7 pid: 6709 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882666.817616:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:3.0:1787882666.817624:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d853050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730541994880:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882666.817636:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882666.817656:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007c92a930/0xf4731e8a7c5dfb57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84331e expref: 7 pid: 6709 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.817668:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007c92a930/0xf4731e8a7c5dfb57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84331e expref: 7 pid: 6709 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.817700:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c92a930/0xf4731e8a7c5dfb57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84331e expref: 7 pid: 6709 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.817718:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882666.817722:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882666.817738:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.817766:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882666.817802:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882666.817815:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1874730564004736:192.168.206.21@tcp:105: 00000100:00100000:3.0:1787882666.817944:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa298a176c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882666.825975:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882666.826211:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541995136 00000100:00100000:2.0:1787882666.826221:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541995136 00000100:00100000:2.0:1787882666.826278:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:2.0:1787882666.826287:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+38:11607:x1874730541995136:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:2.0:1787882666.826639:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+39:11607:x1874730541995136:12345-192.168.206.21@tcp:35:bash.0 Request processed in 351us (670us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787882666.826647:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:1.0:1787882666.827054:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1874730564004736:192.168.206.21@tcp:105: 00010000:00010000:1.0:1787882666.827077:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882666.827115:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d853050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2357:x1874730541994880:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 9491us (9906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882666.827123:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:0.0:1787882667.034343:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882667.034540:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541995264 00000100:00100000:1.0:1787882667.034551:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541995264 00000100:00100000:1.0:1787882667.034613:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 200 00000100:00100000:1.0:1787882667.034624:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+39:11623:x1874730541995264:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1787882667.034646:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882667.034665:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfb65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84332c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.035290:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5dfb6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.035550:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5dfb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.035564:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5dfb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882667.035623:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787882667.035627:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787882667.035649:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5dfb6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.035677:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfb65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84332c expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.035723:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5dfb6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84332c expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.036953:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:1.0:1787882667.036957:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787882667.036961:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa7000, rc 0) 00000100:00100000:1.0:1787882667.037060:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1549500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+40:11623:x1874730541995264:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 2435us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882667.037069:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 200 00000100:00100000:0.0:1787882667.054433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882667.054542:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541995520 00000100:00100000:3.0:1787882667.054555:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541995520 00000100:00100000:3.0:1787882667.054617:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 201 00000100:00100000:3.0:1787882667.054628:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+40:11623:x1874730541995520:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882667.054649:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882667.054670:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfb73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843333 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.054790:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfb7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.054803:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfb7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.054813:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfb7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882667.054823:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787882667.055010:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfb73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843333 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.055029:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfb7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843333 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.055037:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa289160c00) 00010000:00010000:3.0:1787882667.055039:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882667.055043:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030600, rc 0) 00000100:00100000:3.0:1787882667.055098:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+42:11623:x1874730541995520:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 473us (676us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787882667.055106:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 201 00000100:00100000:3.0:1787882667.058098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882667.058376:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541995648 00000100:00100000:0.0:1787882667.058387:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541995648 00000100:00100000:0.0:1787882667.058465:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:0.0:1787882667.058475:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+42:2357:x1874730541995648:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882667.058491:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882667.058516:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfb7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843333 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.058534:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa289160c00) 00010000:00010000:0.0:1787882667.058561:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882667.058617:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:2357:x1874730541995648:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 144us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882667.058625:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:1.0:1787882667.058945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882667.061173:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541995904 00000100:00100000:3.0:1787882667.061186:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541995904 00000100:00100000:3.0:1787882667.061286:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 202 00000100:00100000:3.0:1787882667.061296:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+41:11623:x1874730541995904:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882667.061317:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882667.061336:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfb88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84333a expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.061437:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfb8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.061451:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfb8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.061471:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfb8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882667.061499:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787882667.061824:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfb88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84333a expref: 44 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.061855:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfb8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84333a expref: 43 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.061864:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa289160c00) 00010000:00010000:3.0:1787882667.061866:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787882667.062056:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031e00, rc 0) 00000100:00100000:3.0:1787882667.062166:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+43:11623:x1874730541995904:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 870us (3220us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787882667.062173:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 202 00000100:00100000:1.0:1787882667.084254:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882667.084329:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541996032 00000100:00100000:2.0:1787882667.084338:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541996032 00000100:00100000:2.0:1787882667.084404:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:2.0:1787882667.084415:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+6:2358:x1874730541996032:12345-192.168.206.21@tcp:1:lfs.0 00010000:00010000:2.0:1787882667.084466:0:6710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.084486:0:6710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.084494:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787882667.084499:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882667.084524:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.084567:0:6710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 6 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.084580:0:6710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 6 pid: 6711 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882667.084594:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6710:1874730564004864:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882667.084678:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7171840 going to sleep for 11 seconds 00000100:00100000:3.0:1787882667.087734:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6710:1874730564004864:192.168.206.21@tcp:104: 00010000:00010000:3.0:1787882667.087763:0:6710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882667.087903:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882667.088013:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541996160 00000100:00100000:3.0:1787882667.088020:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541996160 00002000:00100000:3.0:1787882667.088063:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fa2af84bb80 x1874730541996160/t0(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:398/0 lens 504/0 e 0 to 0 dl 1787882678 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787882667.088073:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2af84bb80 with x1874730541996160 ext(0->8) 00010000:00010000:3.0:1787882667.088080:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 7 pid: 6711 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.088110:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 7 pid: 6711 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787882667.088119:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa2af84bb80 00000100:00100000:3.0:1787882667.088155:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:3.0:1787882667.088165:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730541996160:12345-192.168.206.21@tcp:4:lfs.0 00000100:00100000:3.0:1787882667.088657:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2356:x1874730541996160:12345-192.168.206.21@tcp:4:lfs.0 Request processed in 492us (753us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787882667.088665:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00002000:00100000:3.0:1787882667.088673:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fa2af84bb80 x1874730541996160/t4294967308(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:398/0 lens 504/448 e 0 to 0 dl 1787882678 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787882667.088693:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2af84bb80 with x1874730541996160 ext(0->8) 00010000:00010000:3.0:1787882667.088700:0:6715:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 9 pid: 6711 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.088714:0:6715:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 9 pid: 6711 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787882667.088720:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fa2af84bb80 00000100:00100000:0.0:1787882667.094646:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882667.094785:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541996288 00000100:00100000:3.0:1787882667.094795:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541996288 00010000:00010000:3.0:1787882667.094833:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 9 pid: 6711 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882667.094933:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:3.0:1787882667.094944:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2357:x1874730541996288:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882667.094959:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787882667.094978:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787882667.094981:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787882666 00002000:00010000:3.0:1787882667.094983:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787882666 00002000:00010000:3.0:1787882667.094985:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787882666 00010000:00010000:3.0:1787882667.094991:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 9 pid: 6711 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.095005:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 9 pid: 6711 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.095029:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8d6d981/0xf4731e8a7c5dfb5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843325 expref: 9 pid: 6711 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.095045:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787882667.095050:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787882667.095055:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.095064:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.095099:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882667.095150:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2357:x1874730541996288:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 208us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882667.095158:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 76 00010000:00010000:2.0:1787882667.095488:0:6710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.095500:0:6710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.095526:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.095534:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.095541:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.095560:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882667.095564:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.095572:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.095586:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.095593:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b70f5106/0xf4731e8a7c5dfb9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882667.095661:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2358:x1874730541996032:12345-192.168.206.21@tcp:1:lfs.0 Request processed in 11247us (11415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882667.095669:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:0.0:1787882667.098730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882667.098922:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541996544 00000100:00100000:2.0:1787882667.098931:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541996544 00000100:00100000:2.0:1787882667.098988:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:2.0:1787882667.099000:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa288321450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+43:11623:x1874730541996544:12345-192.168.206.21@tcp:35:lfs.0 00000004:00010000:2.0:1787882667.099060:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfb8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84333a expref: 43 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882667.099293:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787882667.099338:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787882667.099801:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787882667.099858:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.099895:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843317 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.099904:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.099938:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843317 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.099952:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843317 expref: 47 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882667.099971:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1874730564004992:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882667.100061:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7171480 going to sleep for 11 seconds 00000100:00100000:0.0:1787882667.102928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882667.102938:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1874730564004992:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882667.102961:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882667.103017:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541996672 00000100:00100000:3.0:1787882667.103024:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541996672 00010000:00010000:3.0:1787882667.103057:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843317 expref: 48 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882667.103096:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 77 00000100:00100000:3.0:1787882667.103105:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+48:2357:x1874730541996672:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882667.103122:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882667.103129:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843317 expref: 48 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.103153:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843317 expref: 48 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.103177:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8e00/0xf4731e8a7c5dfb49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843317 expref: 48 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.103191:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa289160c00) 00010000:00010000:3.0:1787882667.103196:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.103205:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.103212:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.103254:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882667.103301:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+47:2357:x1874730541996672:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 196us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882667.103309:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 77 00010000:00010000:2.0:1787882667.103483:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.103491:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882667.103613:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787882667.103827:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787882667.103978:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af849880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874730564005120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787882667.104038:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882667.104072:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b71710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882667.104191:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564005120 00000100:00100000:0.0:1787882667.104198:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564005120 00000100:00100000:0.0:1787882667.104241:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787882667.104249:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874730564005120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787882667.104335:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874730564005120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882667.104342:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787882667.104550:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af849880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874730564005120:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787882667.105044:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787882667.105101:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874730564005248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787882667.105138:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882667.105155:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882667.105443:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564005248 00000100:00100000:0.0:1787882667.105449:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564005248 00000100:00100000:0.0:1787882667.105475:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787882667.105483:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874730564005248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787882667.105635:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1874730564005248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 152us (495us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787882667.105642:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787882667.105769:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874730564005248:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787882667.105816:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787882667.105850:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.105859:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.105865:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.105944:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882667.105949:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.105957:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.105971:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa289160c00) 00010000:00010000:3.0:1787882667.105982:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787882667.105987:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.105994:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfba4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787882667.113732:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787882667.113864:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00010000:00010000:3.0:1787882667.114106:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787882667.115165:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383264294408ns, next at 384264287646ns, rc = 0 00000001:00080000:0.0:1787882667.115182:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787882667.115255:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa289160c00) 00010000:00010000:0.0:1787882667.115259:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787882667.115283:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfb8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84333a expref: 51 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882667.116467:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa288321450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+50:11623:x1874730541996544:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 17464us (17740us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787882667.116479:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00000020:00080000:0.0:1787882667.116486:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787882667.124428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882667.124669:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541996800 00000100:00100000:3.0:1787882667.124679:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541996800 00000100:00100000:3.0:1787882667.124746:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 203 00000100:00100000:3.0:1787882667.124756:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+50:11623:x1874730541996800:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882667.124779:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882667.124800:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfbab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843341 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.124857:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfbab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843341 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.124906:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfbab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843341 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.124927:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:3.0:1787882667.124930:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787882667.124933:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031000, rc 0) 00000100:00100000:3.0:1787882667.124979:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+51:11623:x1874730541996800:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 224us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882667.124986:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 203 00000100:00100000:2.0:1787882667.135024:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882667.135117:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541997056 00000100:00100000:0.0:1787882667.135126:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541997056 00000100:00100000:0.0:1787882667.135199:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:0.0:1787882667.135211:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+51:11623:x1874730541997056:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1787882667.135450:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+52:11623:x1874730541997056:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 240us (437us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787882667.135458:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:0.0:1787882667.233689:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882667.234139:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541997184 00000100:00100000:1.0:1787882667.234149:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541997184 00000100:00100000:1.0:1787882667.234209:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 204 00000100:00100000:1.0:1787882667.234220:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+52:11633:x1874730541997184:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:1.0:1787882667.234293:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5dfbb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234309:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5dfbb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234320:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5dfbb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234336:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234343:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234365:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234479:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfbc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234488:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234495:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787882667.234532:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234545:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5dfbb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234551:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5dfbb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234569:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5dfbb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234575:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882667.234579:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5dfbb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234586:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5dfbb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234597:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:1.0:1787882667.234606:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882667.234612:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5dfbb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234618:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5dfbb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234632:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234637:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234643:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234648:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882667.234650:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234669:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234677:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa283291100) 00010000:00010000:1.0:1787882667.234688:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882667.234691:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234697:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234711:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234723:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfbc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234729:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfbc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234734:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882667.234738:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfbc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234744:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfbc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234752:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:1.0:1787882667.234754:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882667.234757:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfbc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.234763:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfbc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882667.235199:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+52:11633:x1874730541997184:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 978us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882667.235207:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 204 00000100:00100000:1.0:1787882667.326035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882667.326132:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541997440 00000100:00100000:3.0:1787882667.326157:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541997440 00000100:00100000:3.0:1787882667.326219:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 205 00000100:00100000:3.0:1787882667.326230:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+52:11636:x1874730541997440:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882667.326252:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882667.326273:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfbc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843348 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326348:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfbce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326362:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfbce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326373:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfbce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326389:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326396:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326402:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326546:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfbdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326556:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfbdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326574:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfbdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882667.326592:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787882667.326700:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfbce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326708:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfbce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326715:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfbce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326721:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280030600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882667.326725:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfbce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326732:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfbce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326744:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:3.0:1787882667.326747:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882667.326750:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfbce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326756:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfbce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326769:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326775:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326791:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326796:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882667.326798:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326804:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326812:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa2a0727700) 00010000:00010000:3.0:1787882667.326814:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882667.326816:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326822:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326864:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfbc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843348 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326931:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfbdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843348 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.326939:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:3.0:1787882667.326941:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882667.326944:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264800, rc 0) 00000100:00100000:3.0:1787882667.327246:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+54:11636:x1874730541997440:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1015us (1217us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787882667.327265:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 205 00000100:00100000:2.0:1787882667.338334:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882667.338430:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541997568 00000100:00100000:1.0:1787882667.338439:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541997568 00000100:00100000:1.0:1787882667.338491:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 206 00000100:00100000:1.0:1787882667.338501:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+54:11636:x1874730541997568:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:1.0:1787882667.338673:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.338700:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.338711:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.338737:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.338743:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.338750:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.338756:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882667.338760:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.338776:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.338787:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:1.0:1787882667.338791:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787882667.338795:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.338801:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5dfbea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882667.339136:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+54:11636:x1874730541997568:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 634us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882667.339145:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 206 00000100:00100000:1.0:1787882667.342749:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882667.342833:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541997824 00000100:00100000:2.0:1787882667.342842:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541997824 00000100:00100000:2.0:1787882667.342941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:2.0:1787882667.342954:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+54:11636:x1874730541997824:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1787882667.343205:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:11636:x1874730541997824:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 253us (464us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787882667.343213:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:2.0:1787882667.414018:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882667.414123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541998080 00000100:00100000:3.0:1787882667.414136:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541998080 00000100:00100000:3.0:1787882667.414215:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 207 00000100:00100000:3.0:1787882667.414227:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:11646:x1874730541998080:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1787882667.414260:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882667.414265:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787882667.414299:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7000/0xf4731e8a7c5dfb6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84332c expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.414323:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:3.0:1787882667.414329:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787882667.414357:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbf1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84334f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.414497:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.414709:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfbdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843348 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.414719:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.414766:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfbdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843348 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.414783:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfbdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843348 expref: 55 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882667.414822:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730564005376:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882667.415038:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7157d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787882667.422054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882667.422218:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730564005376:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882667.422254:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882667.423690:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541998208 00000100:00100000:0.0:1787882667.423706:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541998208 00010000:00010000:0.0:1787882667.423768:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfbdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843348 expref: 56 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882667.423813:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:0.0:1787882667.423824:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+56:2356:x1874730541998208:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882667.423845:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882667.423854:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfbdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843348 expref: 56 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.424170:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfbdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843348 expref: 56 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.424200:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfbdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843348 expref: 56 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.424222:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:0.0:1787882667.424227:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.424238:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.424246:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882667.424411:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882667.424502:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:2356:x1874730541998208:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 677us (2461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882667.424512:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 78 00010000:00010000:3.0:1787882667.425145:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.425158:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882667.425186:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787882667.425431:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfbf1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84334f expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.425454:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84334f expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.425463:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:3.0:1787882667.425465:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787882667.425723:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265c00, rc 0) 00000100:00100000:3.0:1787882667.425794:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:11646:x1874730541998080:12345-192.168.206.21@tcp:101:bash.0 Request processed in 11568us (11792us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787882667.425804:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 207 00000100:00100000:3.0:1787882667.433098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882667.433388:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541998464 00000100:00100000:0.0:1787882667.433399:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541998464 00000100:00100000:0.0:1787882667.433518:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 208 00000100:00100000:0.0:1787882667.433530:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+55:11646:x1874730541998464:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:0.0:1787882667.433839:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfc06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.433856:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfc06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.433867:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfc06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787882667.434074:0:6733:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787882667.434100:0:6733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dec70d4b reply state 000000003ebb3f65 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfc06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882667.434108:0:6733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787882667.434635:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+58:11646:x1874730541998464:12345-192.168.206.21@tcp:36:bash.0 Request processed in 1105us (1543us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787882667.434642:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 208 00000020:00080000:0.0:1787882667.434647:0:6733:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787882667.436307:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfc06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.436322:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfc06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.436353:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfc06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.436359:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882667.436364:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfc06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.436373:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfc06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.436390:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:3.0:1787882667.436393:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882667.436398:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfc06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.436406:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfc06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882667.438404:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882667.438713:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541998592 00000100:00100000:0.0:1787882667.438723:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541998592 00000100:00100000:0.0:1787882667.438867:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 209 00000100:00100000:0.0:1787882667.438909:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+57:11646:x1874730541998592:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1787882667.438932:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882667.438950:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfc0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843356 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.439021:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.439034:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84334f expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.439043:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.439075:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84334f expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.439104:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84334f expref: 58 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882667.439118:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d9c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730564005504:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882667.439193:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa282b4ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787882667.442215:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882667.442291:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541998720 00000100:00100000:3.0:1787882667.442299:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541998720 00010000:00010000:3.0:1787882667.442334:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84334f expref: 59 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882667.442378:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:3.0:1787882667.442387:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:2357:x1874730541998720:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882667.442401:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882667.442408:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84334f expref: 59 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.442438:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84334f expref: 59 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.442468:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:3.0:1787882667.442474:0:8466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.442482:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.442489:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.442506:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882667.442565:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:2357:x1874730541998720:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 178us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882667.442573:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 79 00010000:00010000:0.0:1787882667.442719:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfbf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84334f expref: 58 pid: 5844 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882667.442736:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d9c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874730564005504:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882667.442761:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.442771:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.442777:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882667.442818:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787882667.442823:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882667.442842:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.442908:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfc0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843356 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.442923:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843356 expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.442938:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:0.0:1787882667.442940:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882667.442943:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8600, rc 0) 00000100:00100000:0.0:1787882667.442970:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+57:11646:x1874730541998592:12345-192.168.206.21@tcp:101:bash.0 Request processed in 4064us (4573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882667.442977:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 209 00000100:00100000:1.0:1787882667.446306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882667.446427:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541998976 00000100:00100000:2.0:1787882667.446436:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541998976 00000100:00100000:2.0:1787882667.446496:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:2.0:1787882667.446508:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+57:11646:x1874730541998976:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:2.0:1787882667.446997:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+58:11646:x1874730541998976:12345-192.168.206.21@tcp:35:bash.0 Request processed in 490us (699us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787882667.447019:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:2.0:1787882667.521197:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882667.524124:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541999104 00000100:00100000:1.0:1787882667.524139:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541999104 00000100:00100000:1.0:1787882667.524282:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 210 00000100:00100000:1.0:1787882667.524294:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+58:11652:x1874730541999104:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1787882667.524317:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882667.524336:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5dfc1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84335d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.524397:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfc22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.524411:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfc22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.524424:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfc22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882667.524477:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787882667.524481:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787882667.524501:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfc22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.524525:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5dfc1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84335d expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.524563:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfc22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84335d expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.524572:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:1.0:1787882667.524575:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787882667.524579:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6e00, rc 0) 00000100:00100000:1.0:1787882667.524655:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:11652:x1874730541999104:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 362us (3467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882667.524662:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 210 00000100:00100000:2.0:1787882667.532091:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882667.532179:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541999232 00000100:00100000:3.0:1787882667.532191:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541999232 00000100:00100000:3.0:1787882667.532302:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 211 00000100:00100000:3.0:1787882667.532314:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:11652:x1874730541999232:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882667.532335:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882667.532356:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfc29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843364 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532449:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfc30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532486:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfc30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532498:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfc30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532516:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfc37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532523:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532530:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532635:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfc3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532645:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfc3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532652:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfc3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882667.532697:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787882667.532702:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882667.532721:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfc3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532733:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfc3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532754:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfc30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532760:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfc30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532766:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfc30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532771:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882667.532776:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfc30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532782:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfc30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532794:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:3.0:1787882667.532797:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882667.532801:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfc30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532807:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5dfc30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532820:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532827:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfc37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532833:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfc37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532845:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882667.532849:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfc37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532855:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfc37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532863:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa2a0727700) 00010000:00010000:3.0:1787882667.532865:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882667.532906:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfc37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532913:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5dfc37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532949:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265600/0xf4731e8a7c5dfc29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843364 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532963:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfc3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843364 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.532971:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:3.0:1787882667.532974:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882667.532976:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264800, rc 0) 00000100:00100000:3.0:1787882667.533039:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:11652:x1874730541999232:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 727us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882667.533047:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 211 00000100:00100000:2.0:1787882667.538616:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882667.538716:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541999360 00000100:00100000:1.0:1787882667.538725:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541999360 00000100:00100000:1.0:1787882667.538785:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:1.0:1787882667.538795:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1156a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:2357:x1874730541999360:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882667.538809:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882667.538832:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5dfc3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843364 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.538850:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:1.0:1787882667.538854:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882667.538970:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1156a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:2357:x1874730541999360:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 176us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882667.538978:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:3.0:1787882667.539236:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882667.539592:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541999616 00000100:00100000:1.0:1787882667.539599:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541999616 00000100:00100000:1.0:1787882667.539635:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 212 00000100:00100000:1.0:1787882667.539650:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:11652:x1874730541999616:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1787882667.539668:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882667.539697:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5dfc45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84336b expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.539786:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.539800:0:6733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843356 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.539807:0:6733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.539838:0:6733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843356 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.539851:0:6733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843356 expref: 60 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882667.539864:0:6733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730564005632:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882667.539959:0:6733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b9479a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787882667.543280:0:6733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730564005632:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882667.543308:0:6733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882667.545326:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882667.545572:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730541999744 00000100:00100000:3.0:1787882667.545582:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730541999744 00010000:00010000:3.0:1787882667.545625:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843356 expref: 61 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882667.545709:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:3.0:1787882667.545720:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d850050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:2356:x1874730541999744:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882667.545735:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882667.545742:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843356 expref: 61 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.545755:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843356 expref: 61 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.545777:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfc14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843356 expref: 61 pid: 5843 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.545792:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:3.0:1787882667.545797:0:8466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.545806:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.545814:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882667.545851:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882667.545945:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d850050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:2356:x1874730541999744:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 226us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882667.545968:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 80 00010000:00010000:0.0:1787882667.547048:0:6733:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.547061:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882667.547082:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787882667.547247:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7400/0xf4731e8a7c5dfc45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84336b expref: 61 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.547264:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84336b expref: 60 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882667.547272:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:0.0:1787882667.547275:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787882667.547278:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6200, rc 0) 00000100:00100000:0.0:1787882667.547340:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:11652:x1874730541999616:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 7691us (8103us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787882667.547348:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 212 00000100:00100000:0.0:1787882667.551371:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882667.551465:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542000000 00000100:00100000:1.0:1787882667.551475:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542000000 00000100:00100000:1.0:1787882667.551541:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:1.0:1787882667.551562:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:11652:x1874730542000000:12345-192.168.206.21@tcp:103:lfs.0 00010000:00010000:1.0:1787882667.551576:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882667.551600:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfbab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843341 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.551617:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:1.0:1787882667.551622:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882667.551690:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:11652:x1874730542000000:12345-192.168.206.21@tcp:103:lfs.0 Request processed in 119us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882667.551698:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:2.0:1787882667.561152:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882667.561192:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542000128 00000100:00100000:1.0:1787882667.561202:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542000128 00000100:00100000:1.0:1787882667.561256:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 213 00000100:00100000:1.0:1787882667.561267:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:11652:x1874730542000128:12345-192.168.206.21@tcp:58:lfs.0 00010000:00010000:1.0:1787882667.561365:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.561380:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.561390:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787882667.561842:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787882667.562270:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:11652:x1874730542000128:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 1001us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882667.562281:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 213 00000100:00100000:3.0:1787882667.566976:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882667.567211:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542000256 00000100:00100000:1.0:1787882667.567222:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542000256 00000100:00100000:1.0:1787882667.567278:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 214 00000100:00100000:1.0:1787882667.567289:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+59:11652:x1874730542000256:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1787882667.567331:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882667.567351:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfc61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843372 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.567408:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.567420:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfc61 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843372 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.567438:0:5845:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.567754:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfc61 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843372 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.567841:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:1.0:1787882667.567845:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787882667.567851:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfc61 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843372 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882667.567860:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6c00, rc 0) 00000100:00100000:2.0:1787882667.568269:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:11652:x1874730542000256:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 979us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882667.568277:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 214 00000100:00100000:0.0:1787882667.683905:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882667.683946:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882667.683983:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882667.684011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882667.684036:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542000640 00000100:00100000:0.0:1787882667.684044:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542000640 00000100:00100000:0.0:1787882667.684086:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542000768 00000100:00100000:0.0:1787882667.684089:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542000768 00000100:00100000:0.0:1787882667.684109:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:0.0:1787882667.684118:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2358:x1874730542000640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882667.684182:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2358:x1874730542000640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882667.684185:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:0.0:1787882667.684190:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:1.0:1787882667.684194:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2359:x1874730542000768:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882667.684222:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2359:x1874730542000768:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882667.684229:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:0.0:1787882667.684230:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882667.684518:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542000512 00000100:00100000:2.0:1787882667.684522:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542000512 00000100:00100000:2.0:1787882667.684557:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542000896 00000100:00100000:2.0:1787882667.684560:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542000896 00000100:00100000:2.0:1787882667.684604:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 158 00000100:00100000:2.0:1787882667.684612:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:2359:x1874730542000512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882667.684648:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:2359:x1874730542000512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882667.684654:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 158 00000100:00100000:2.0:1787882667.684674:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 159 00000100:00100000:2.0:1787882667.684691:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c154a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730542000896:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882667.684716:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c154a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2358:x1874730542000896:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882667.684723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 159 00000100:00100000:3.0:1787882667.684952:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542000384 00000100:00100000:3.0:1787882667.684957:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542000384 00000100:00100000:3.0:1787882667.685026:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 297 00000100:00100000:3.0:1787882667.685033:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2358:x1874730542000384:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882667.685069:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2358:x1874730542000384:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882667.685075:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 297 00000100:00080000:1.0:1787882667.686595:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787882668.138904:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787882668.522328:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882668.522336:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882668.522387:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787882668.522395:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787882668.522530:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29da97b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730564005760:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787882668.522638:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa282b4aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787882668.529190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.529552:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29da97b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730564005760:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787882668.529753:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542001024 00000100:00100000:2.0:1787882668.529772:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542001024 00000100:00080000:1.0:1787882668.530047:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882668.530108:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 215 00000100:00100000:3.0:1787882668.530122:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:11653:x1874730542001024:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787882668.530153:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787882668.530277:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:11653:x1874730542001024:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 158us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882668.530285:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 215 00000100:00100000:2.0:1787882668.539089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882668.539198:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542001152 00000100:00100000:3.0:1787882668.539209:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542001152 00000100:00100000:3.0:1787882668.539580:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 216 00000100:00100000:3.0:1787882668.539593:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:11653:x1874730542001152:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787882668.539690:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfc68 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.539706:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfc68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.539746:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfc68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.539764:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc6f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.539772:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.539780:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.539901:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.539912:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.539919:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882668.539959:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787882668.539974:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882668.539986:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.539997:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfc68 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540004:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfc68 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540022:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfc68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540028:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882668.540032:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfc68 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540040:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfc68 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540052:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:3.0:1787882668.540055:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882668.540059:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfc68 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540066:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031e00/0xf4731e8a7c5dfc68 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540079:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc6f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540086:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc6f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540091:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540097:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280030600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882668.540101:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc6f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540116:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc6f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540125:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9fa2a0727700) 00010000:00010000:3.0:1787882668.540127:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882668.540130:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc6f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540135:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc6f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540164:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540170:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540175:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540180:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882668.540183:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540189:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540196:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:3.0:1787882668.540198:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882668.540200:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.540216:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882668.540498:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:11653:x1874730542001152:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 Request processed in 905us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882668.540510:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 216 00000100:00100000:0.0:1787882668.551801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882668.551893:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542001408 00000100:00100000:3.0:1787882668.551903:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542001408 00000100:00100000:3.0:1787882668.551958:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 217 00000100:00100000:3.0:1787882668.551968:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+60:11653:x1874730542001408:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882668.551987:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882668.552006:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc7d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843379 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552097:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552111:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552120:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882668.552131:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787882668.552225:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552234:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552270:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552277:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280030600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882668.552283:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552290:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552303:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:3.0:1787882668.552306:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787882668.552311:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552317:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280030600/0xf4731e8a7c5dfc84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552357:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc7d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843379 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552368:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:3.0:1787882668.552371:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787882668.552374:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc7d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843379 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.552384:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031000, rc 0) 00000100:00100000:3.0:1787882668.552449:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:11653:x1874730542001408:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 482us (655us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787882668.552465:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 217 00000100:00100000:2.0:1787882668.556564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.557143:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542001536 00000100:00100000:0.0:1787882668.557153:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542001536 00000100:00100000:0.0:1787882668.557244:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 218 00000100:00100000:0.0:1787882668.557265:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:11653:x1874730542001536:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787882668.557300:0:6733:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787882668.557416:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:11653:x1874730542001536:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 163us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882668.557424:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 218 00000100:00100000:0.0:1787882668.572207:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882668.585933:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542001792 00000100:00100000:3.0:1787882668.585948:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542001792 00000100:00100000:3.0:1787882668.586027:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 219 00000100:00100000:3.0:1787882668.586038:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:11653:x1874730542001792:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882668.586057:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882668.586060:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787882668.586088:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5dfc22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84335d expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.586110:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:3.0:1787882668.586115:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787882668.586129:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843380 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787882668.586730:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787882668.586965:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5dfc99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.586979:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5dfc99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.586991:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5dfc99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.587048:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031000/0xf4731e8a7c5dfc92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843380 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.587065:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5dfc99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843380 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.587072:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882668.587075:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787882668.587078:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791b400, rc 0) 00000100:00100000:2.0:1787882668.587161:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+62:11653:x1874730542001792:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1124us (14962us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787882668.587169:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 219 00000100:00100000:1.0:1787882668.593343:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882668.594397:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542002048 00000100:00100000:3.0:1787882668.594410:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542002048 00000100:00100000:3.0:1787882668.594518:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 220 00000100:00100000:3.0:1787882668.594528:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+62:11653:x1874730542002048:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787882668.594729:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882668.594758:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b400/0xf4731e8a7c5dfc99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843380 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.594791:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00000) 00010000:00010000:2.0:1787882668.594807:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787882668.594832:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfca7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.594846:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfca7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.594855:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfca7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.594893:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xdc967a37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.594902:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdc967a37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.594909:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdc967a37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595004:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfca7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595011:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfca7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595017:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfca7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595023:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791bc00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882668.595028:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfca7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595043:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfca7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595052:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:2.0:1787882668.595055:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882668.595059:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfca7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595065:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfca7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595074:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdc967a37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595080:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdc967a37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595086:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdc967a37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595091:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791aa00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882668.595094:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdc967a37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595100:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdc967a37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595108:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xdc967a37 (ffff9fa285a00500) 00010000:00010000:2.0:1787882668.595110:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882668.595113:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdc967a37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.595129:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdc967a37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.595218:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:11653:x1874730542002048:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 690us (1883us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787882668.595226:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 220 00000100:00100000:3.0:1787882668.603850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882668.603970:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542002176 00000100:00100000:2.0:1787882668.603979:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542002176 00000100:00100000:2.0:1787882668.604028:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 221 00000100:00100000:2.0:1787882668.604038:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+61:11653:x1874730542002176:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882668.604058:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882668.604081:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843387 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.604120:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5dfcbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.604133:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5dfcbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.604144:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5dfcbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.604242:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843387 expref: 63 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.604275:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5dfcbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843387 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.604296:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00300) 00010000:00010000:2.0:1787882668.604299:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787882668.604302:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a400, rc 0) 00000100:00100000:2.0:1787882668.604364:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+62:11653:x1874730542002176:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 327us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882668.604383:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 221 00000100:00100000:3.0:1787882668.608216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882668.610271:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542002432 00000100:00100000:2.0:1787882668.610284:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542002432 00000100:00100000:2.0:1787882668.610406:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 222 00000100:00100000:2.0:1787882668.610421:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+62:11653:x1874730542002432:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787882668.610970:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.610989:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.611000:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787882668.611231:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1787882668.611241:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384760370896ns, next at 385760368604ns, rc = 0 00000004:00010000:2.0:1787882668.611329:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9181a78 reply state 000000005cd7cb91 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.611339:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787882668.611778:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+64:11653:x1874730542002432:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 1358us (3569us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787882668.611802:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 222 00000100:00100000:1.0:1787882668.616296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882668.616386:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542002560 00000100:00100000:2.0:1787882668.616396:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542002560 00000100:00100000:2.0:1787882668.616442:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 223 00000100:00100000:2.0:1787882668.616464:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+64:11653:x1874730542002560:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882668.616487:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882668.616505:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84338e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.616582:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84338e expref: 65 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.616597:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84338e expref: 65 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.616617:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00300) 00010000:00010000:2.0:1787882668.616621:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787882668.616625:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a800, rc 0) 00000100:00100000:2.0:1787882668.616909:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+65:11653:x1874730542002560:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 446us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882668.616917:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 223 00010000:00010000:3.0:1787882668.617199:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.617208:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.617234:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.617240:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791aa00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882668.617244:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.617251:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.617263:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00300) 00010000:00010000:3.0:1787882668.617266:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787882668.617270:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.617276:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfcc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.625037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882668.625126:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542002688 00000100:00100000:3.0:1787882668.625135:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542002688 00000100:00100000:3.0:1787882668.625237:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:3.0:1787882668.625248:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2357:x1874730542002688:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787882668.625579:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1157800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:2357:x1874730542002688:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 325us (543us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787882668.625588:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00080000:1.0:1787882668.625640:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787882668.630463:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.630767:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542002944 00000100:00100000:0.0:1787882668.630779:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542002944 00000100:00100000:0.0:1787882668.630833:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:0.0:1787882668.630844:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+64:11653:x1874730542002944:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787882668.631091:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+65:11653:x1874730542002944:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 248us (646us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787882668.631099:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:2.0:1787882668.633657:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.633907:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542003200 00000100:00100000:0.0:1787882668.633919:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542003200 00000100:00100000:0.0:1787882668.633977:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 224 00000100:00100000:0.0:1787882668.633987:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+65:11653:x1874730542003200:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787882668.634095:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+65:11653:x1874730542003200:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 109us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882668.634103:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 224 00000100:00100000:1.0:1787882668.640198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.640355:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542003328 00000100:00100000:0.0:1787882668.640365:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542003328 00000100:00100000:0.0:1787882668.640426:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 225 00000100:00100000:0.0:1787882668.640436:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+65:11653:x1874730542003328:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882668.640746:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882668.640768:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5dfcd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843395 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.640861:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfcd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.640916:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.640929:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882668.640966:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882668.640985:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfcd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.641012:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8c00/0xf4731e8a7c5dfcd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843395 expref: 67 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.641031:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfcd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843395 expref: 66 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.641040:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00300) 00010000:00010000:0.0:1787882668.641043:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787882668.641046:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d8400, rc 0) 00000100:00100000:0.0:1787882668.641161:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+66:11653:x1874730542003328:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 726us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882668.641168:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 225 00000100:00100000:1.0:1787882668.658029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882668.658216:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542003456 00000100:00100000:3.0:1787882668.658226:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542003456 00000100:00100000:2.0:1787882668.658431:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:2.0:1787882668.658442:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+10:2359:x1874730542003456:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882668.658483:0:12080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882668.658502:0:12080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000657df6f5/0xf4731e8a7c5dfcdf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84339c expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787882668.658528:0:12080:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90ecac, blocks: 0x1 00010000:00010000:2.0:1787882668.658555:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1787882668.658561:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882668.658577:0:12080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000657df6f5/0xf4731e8a7c5dfcdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84339c expref: 11 pid: 12080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.658594:0:12080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000657df6f5/0xf4731e8a7c5dfcdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84339c expref: 11 pid: 12080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.658608:0:12080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a000, rc 0) 00000100:00100000:2.0:1787882668.658684:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:2359:x1874730542003456:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 234us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882668.658692:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:3.0:1787882668.662141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.662231:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542003712 00000100:00100000:0.0:1787882668.662242:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542003712 00000100:00100000:0.0:1787882668.662303:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 226 00000100:00100000:0.0:1787882668.662328:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+66:11653:x1874730542003712:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787882668.662441:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+66:11653:x1874730542003712:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 115us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882668.662456:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 226 00000100:00100000:3.0:1787882668.666754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882668.666984:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542003840 00000100:00100000:1.0:1787882668.666994:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542003840 00000100:00100000:1.0:1787882668.667054:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:1.0:1787882668.667063:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:11653:x1874730542003840:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787882668.667080:0:6711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882668.667099:0:6711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8433a3 expref: -99 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.667132:0:6711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000657df6f5/0xf4731e8a7c5dfcdf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84339c expref: 12 pid: 12080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.667141:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882668.667146:0:6711:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882668.667151:0:6711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.667186:0:6711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000657df6f5/0xf4731e8a7c5dfcdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84339c expref: 12 pid: 12080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.667199:0:6711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000657df6f5/0xf4731e8a7c5dfcdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84339c expref: 12 pid: 12080 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882668.667221:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6711:1874730564005888:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882668.667306:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287a26000 going to sleep for 11 seconds 00000100:00100000:1.0:1787882668.672067:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6711:1874730564005888:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882668.672103:0:6711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 12 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.672125:0:6711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6e00, rc 0) 00000100:00100000:1.0:1787882668.672192:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+12:11653:x1874730542003840:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 5129us (5448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882668.672201:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:3.0:1787882668.672423:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882668.672582:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542003968 00000100:00100000:1.0:1787882668.672590:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542003968 00010000:00010000:1.0:1787882668.672619:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000657df6f5/0xf4731e8a7c5dfcdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84339c expref: 12 pid: 12080 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882668.672647:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:1.0:1787882668.672666:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+12:2357:x1874730542003968:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882668.672689:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882668.672711:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000657df6f5/0xf4731e8a7c5dfcdf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84339c expref: 12 pid: 12080 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.672725:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000657df6f5/0xf4731e8a7c5dfcdf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84339c expref: 12 pid: 12080 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.672766:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000657df6f5/0xf4731e8a7c5dfcdf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84339c expref: 12 pid: 12080 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.672781:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882668.672786:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882668.672795:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.672805:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.672837:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 11 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882668.672851:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1874730564006016:192.168.206.21@tcp:105: 00000100:00100000:1.0:1787882668.672937:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287a26000 going to sleep for 11 seconds 00000100:00100000:1.0:1787882668.677179:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1874730564006016:192.168.206.21@tcp:105: 00010000:00010000:1.0:1787882668.677203:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882668.677258:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:2357:x1874730542003968:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 4592us (4834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882668.677268:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:2.0:1787882668.688051:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882668.688147:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542004096 00000100:00100000:3.0:1787882668.688157:0:6714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542004096 00002000:00100000:3.0:1787882668.688208:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9fa2c1156680 x1874730542004096/t0(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:399/0 lens 504/0 e 0 to 0 dl 1787882679 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787882668.688218:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2c1156680 with x1874730542004096 ext(0->12) 00002000:00010000:3.0:1787882668.688224:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2c1156680 00000100:00100000:3.0:1787882668.688258:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:3.0:1787882668.688268:0:6714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+11:2356:x1874730542004096:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787882668.688925:0:6714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1156680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2356:x1874730542004096:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 Request processed in 654us (881us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787882668.688936:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00002000:00100000:3.0:1787882668.688944:0:6714:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9fa2c1156680 x1874730542004096/t4294967320(0) o4->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:399/0 lens 504/448 e 0 to 0 dl 1787882679 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787882668.688953:0:6714:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa2c1156680 with x1874730542004096 ext(0->12) 00002000:00010000:3.0:1787882668.688957:0:6714:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa2c1156680 00000100:00100000:2.0:1787882668.702961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.713132:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542004224 00000100:00100000:0.0:1787882668.713145:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542004224 00000100:00100000:0.0:1787882668.713293:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 227 00000100:00100000:0.0:1787882668.713305:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+66:11653:x1874730542004224:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787882668.794195:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787882668.794224:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1787882668.794240:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:2.0:1787882668.794276:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787882668.794311:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa2b7157840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787882668.794316:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa285a37a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa2b7157600 00000020:00080000:2.0:1787882668.794318:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa285a37200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa2b986bc00 00000020:00080000:2.0:1787882668.794366:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa298a17e40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787882668.794370:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2b603ea00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa298a176c0 00000020:00080000:2.0:1787882668.794373:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2b603e500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa287a54c00 00000100:00100000:3.0:1787882668.795089:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:11653:x1874730542004224:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 Request processed in 81778us (92130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882668.795100:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 227 00000100:00100000:0.0:1787882668.795388:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564006400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787882668.795440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882668.795511:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787882668.795518:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564006272:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787882668.795544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882668.796118:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564006400 00000100:00100000:1.0:1787882668.796128:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564006400 00000100:00100000:2.0:1787882668.796140:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564006144:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787882668.796180:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882668.796193:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564006272 00000100:00100000:1.0:1787882668.796210:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564006272 00000100:00100000:2.0:1787882668.796236:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564006144 00000100:00100000:2.0:1787882668.796242:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564006144 00000100:00100000:1.0:1787882668.796242:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787882668.796255:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29da94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730564006400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787882668.796269:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787882668.796278:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730564006272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787882668.796295:0:12080:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1787882668.796317:0:12080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.796338:0:12080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5dfaaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843302 expref: 12 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.796355:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787882668.796360:0:12080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882668.796366:0:12080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.796398:0:12080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5dfaaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843302 expref: 12 pid: 6710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.796413:0:12080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5dfaaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843302 expref: 12 pid: 6710 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.796440:0:12080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12080:1874730564006528:192.168.206.21@tcp:104: 00002000:00010000:1.0:1787882668.796450:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787882668.796455:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787882668 00002000:00010000:1.0:1787882668.796458:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787882668.796460:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787882668 -> 1787882668 00002000:00010000:1.0:1787882668.796462:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787882668.796507:0:12080:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7171900 going to sleep for 11 seconds 00000100:00100000:1.0:1787882668.796514:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29da94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1874730564006400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 261us (1072us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787882668.796523:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787882668.796569:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787882668.796573:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1787882668.796807:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787882668.796988:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787882668.797509:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787882668.797523:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874730564006144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787882668.797544:0:9930:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1787882668.797582:0:9930:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a90ecaa, atime: 0x6a90ecaa, ctime: 0x6a90ecaa, blocks: 0x1 00010000:00010000:2.0:1787882668.797590:0:9930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c612236/0xf4731e8a7c5dfcf4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.797602:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1787882668.797606:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882668.797613:0:9930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c612236/0xf4731e8a7c5dfcf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.797629:0:9930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c612236/0xf4731e8a7c5dfcf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.797638:0:9930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c612236/0xf4731e8a7c5dfcf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.797646:0:9930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c612236/0xf4731e8a7c5dfcf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.797778:0:9930:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882668.798198:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882668.798206:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c612236/0xf4731e8a7c5dfcf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.798217:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882668.798221:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c612236/0xf4731e8a7c5dfcf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.798230:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c612236/0xf4731e8a7c5dfcf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.798259:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c612236/0xf4731e8a7c5dfcf4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.798266:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c612236/0xf4731e8a7c5dfcf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.798288:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882668.798290:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882668.798291:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1874730564006144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 770us (2108us total) trans 4294967310 rc 0/0 00010000:00010000:0.0:1787882668.798293:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882668.798303:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1787882668.798361:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2c1156300/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787882668.798368:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1156300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564006144:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787882668.799635:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2bf43dc00/2, rc 0, transno 4294967321 00000100:00100000:1.0:1787882668.799648:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564006400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787882668.807189:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.807259:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542004352 00000100:00100000:0.0:1787882668.807268:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542004352 00010000:00010000:0.0:1787882668.807305:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5dfaaf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843302 expref: 13 pid: 6710 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882668.807347:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:0.0:1787882668.807356:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2357:x1874730542004352:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882668.807370:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882668.807376:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5dfaaf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843302 expref: 13 pid: 6710 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.807390:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5dfaaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843302 expref: 13 pid: 6710 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.807415:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787882668.807421:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787882668.807448:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.807458:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.807480:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882668.807535:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2357:x1874730542004352:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 179us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882668.807543:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:2.0:1787882668.808091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882668.808132:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542004480 00000100:00100000:2.0:1787882668.808138:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542004480 00000100:00100000:2.0:1787882668.808174:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:2.0:1787882668.808183:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+13:2357:x1874730542004480:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1787882668.809570:0:12080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5dfaaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843302 expref: 13 pid: 6710 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882668.809592:0:12080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12080:1874730564006528:192.168.206.21@tcp:104: 00010000:00010000:3.0:1787882668.809622:0:12080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.809634:0:12080:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.809641:0:12080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.809660:0:12080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.809669:0:12080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.809696:0:12080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787882668.810992:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3306:x1874730564006272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14710us (15441us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787882668.811004:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1787882668.812739:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882668.812752:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.812766:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882668.812771:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.812783:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.812803:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.812811:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f0b490e/0xf4731e8a7c5dfced lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.812849:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882668.812851:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882668.812853:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787882668.817746:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2c1156a00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787882668.817846:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1156a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564006272:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1787882668.857007:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1787882668.857025:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1787882668.857032:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1787882668.857390:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2357:x1874730542004480:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 Request processed in 49200us (49292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882668.857401:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:2.0:1787882668.861941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.862051:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542004736 00000100:00100000:0.0:1787882668.862060:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542004736 00000100:00100000:0.0:1787882668.862159:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 228 00000100:00100000:0.0:1787882668.862169:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:11653:x1874730542004736:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787882668.862222:0:6733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882668.862250:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfcd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843395 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.862268:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00300) 00010000:00010000:0.0:1787882668.862274:0:6733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787882668.862301:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5dfcfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.862314:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5dfcfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.862339:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5dfcfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787882668.862703:0:6733:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b3379e3 reply state 00000000581c7f38 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5dfcfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882668.862713:0:6733:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787882668.862808:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:11653:x1874730542004736:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 639us (875us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1787882668.862815:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 228 00010000:00010000:3.0:1787882668.867693:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5dfcfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.867710:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5dfcfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.867718:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5dfcfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.867743:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882668.867748:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5dfcfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.867756:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5dfcfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.867773:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00300) 00010000:00010000:3.0:1787882668.867776:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882668.867781:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5dfcfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.867786:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9200/0xf4731e8a7c5dfcfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.871128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882668.871967:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542004864 00000100:00100000:1.0:1787882668.871979:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542004864 00000100:00100000:1.0:1787882668.872034:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:1.0:1787882668.872399:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa298adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730542004864:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787882668.872596:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787882668.872600:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787882668 -> 1787882667 00002000:00010000:1.0:1787882668.872603:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787882666 00002000:00010000:1.0:1787882668.872605:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787882668 -> 1787882667 00002000:00010000:1.0:1787882668.872607:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787882668.872727:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa298adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730542004864:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 683us (1608us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787882668.872748:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:2.0:1787882668.875734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.875953:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542005120 00000100:00100000:0.0:1787882668.875963:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542005120 00000100:00100000:0.0:1787882668.876014:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 229 00000100:00100000:0.0:1787882668.876024:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:11653:x1874730542005120:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787882668.876099:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.876115:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5dfcbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843387 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.876123:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.876156:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5dfcbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843387 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.876169:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5dfcbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843387 expref: 20 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882668.876206:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730564006656:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882668.876304:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf7490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882668.881815:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874730564006656:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882668.881845:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.883426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.883526:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542005248 00000100:00100000:0.0:1787882668.883544:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542005248 00010000:00010000:0.0:1787882668.883583:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5dfcbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843387 expref: 21 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882668.883626:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 83 00000100:00100000:0.0:1787882668.883637:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:2357:x1874730542005248:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882668.883652:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882668.883659:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5dfcbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843387 expref: 21 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.883682:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5dfcbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843387 expref: 21 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.883706:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5dfcbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843387 expref: 21 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.883724:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00300) 00010000:00010000:0.0:1787882668.883731:0:8466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.883755:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.883762:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.883795:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882668.883845:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:2357:x1874730542005248:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 210us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882668.883852:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 83 00010000:00010000:2.0:1787882668.884080:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.884088:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.884112:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.884118:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.884125:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.884131:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882668.884135:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.884162:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.884172:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00300) 00010000:00010000:2.0:1787882668.884175:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787882668.884178:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.884184:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8400/0xf4731e8a7c5dfd02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.884229:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:11653:x1874730542005120:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 Request processed in 8207us (8504us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787882668.884237:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 229 00000100:00100000:2.0:1787882668.887645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.887725:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542005376 00000100:00100000:0.0:1787882668.887735:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542005376 00000100:00100000:0.0:1787882668.887789:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:0.0:1787882668.887800:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730542005376:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787882668.887840:0:9930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.887861:0:9930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.887916:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787882668.887920:0:9930:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787882668.887925:0:9930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.887959:0:9930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 8 pid: 6711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.887992:0:9930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 8 pid: 6711 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882668.888006:0:9930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9930:1874730564006784:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882668.888082:0:9930:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf7490c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882668.891325:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.891414:0:9930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9930:1874730564006784:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882668.891443:0:9930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.891635:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542005504 00000100:00100000:2.0:1787882668.891642:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542005504 00010000:00010000:2.0:1787882668.891687:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 9 pid: 6711 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.891725:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:2.0:1787882668.891735:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+9:2356:x1874730542005504:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882668.891747:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882668.891768:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 9 pid: 6711 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.891781:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 9 pid: 6711 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.891816:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a53de4/0xf4731e8a7c5dfce6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433a3 expref: 9 pid: 6711 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.891831:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882668.891835:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882668.891841:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.891851:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.891898:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882668.891940:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730542005504:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 207us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882668.891947:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 84 00010000:00010000:3.0:1787882668.892455:0:9930:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.892466:0:9930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.892493:0:9930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.892501:0:9930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.892510:0:9930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.892525:0:9930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882668.892530:0:9930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.892541:0:9930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.892555:0:9930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.892563:0:9930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b8b96fd/0xf4731e8a7c5dfd09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882668.892628:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730542005376:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 Request processed in 4829us (4991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882668.892636:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:1.0:1787882668.899065:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882668.899137:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542005760 00000100:00100000:2.0:1787882668.899146:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542005760 00000100:00100000:2.0:1787882668.899200:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 230 00000100:00100000:2.0:1787882668.899210:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:11653:x1874730542005760:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787882668.899283:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfd10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.899300:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfd10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.899311:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfd10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.899522:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.899533:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84338e expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.899555:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.899589:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84338e expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.899601:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84338e expref: 20 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.899614:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730564006912:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882668.899701:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7171000 going to sleep for 11 seconds 00000100:00100000:1.0:1787882668.902100:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730564006912:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882668.902128:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882668.904153:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.904226:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542005888 00000100:00100000:0.0:1787882668.904234:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542005888 00010000:00010000:0.0:1787882668.904272:0:8466:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84338e expref: 21 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882668.904309:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:0.0:1787882668.904319:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:2357:x1874730542005888:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882668.904333:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882668.904340:0:8466:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84338e expref: 21 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.904354:0:8466:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84338e expref: 21 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.904376:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a800/0xf4731e8a7c5dfcca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84338e expref: 21 pid: 5843 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.904405:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00300) 00010000:00010000:0.0:1787882668.904411:0:8466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.904420:0:8466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.904426:0:8466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.904464:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882668.904521:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:2357:x1874730542005888:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 204us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882668.904529:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 85 00010000:00010000:2.0:1787882668.904669:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.904685:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882668.904864:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787882668.905055:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787882668.905101:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787882668.905195:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874730564007040:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787882668.905246:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882668.905282:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7171d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787882668.905641:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564007040 00000100:00100000:0.0:1787882668.905647:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564007040 00000100:00100000:0.0:1787882668.905702:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787882668.905711:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1874730564007040:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787882668.905785:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1874730564007040:12345-0@lo:1000:mdt00_001.0 Request processed in 75us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882668.905792:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787882668.906368:0:5844:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1787882668.906375:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1787882668.906394:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2bf43dc00, transno 4294967321 00000100:00100000:2.0:1787882668.906416:0:5844:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fa2c1156a00 x1874730564006272/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787882684 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882668.906429:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874730564007040:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787882668.907363:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787882668.907443:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874730564007168:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787882668.907497:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882668.907533:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7171840 going to sleep for 11 seconds 00000100:00100000:0.0:1787882668.907855:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564007168 00000100:00100000:0.0:1787882668.907862:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564007168 00000100:00100000:0.0:1787882668.907932:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787882668.907941:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1874730564007168:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787882668.908135:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1874730564007168:12345-0@lo:1000:mdt00_001.0 Request processed in 194us (637us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787882668.908164:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787882668.908322:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874730564007168:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787882668.908355:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908364:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908371:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908377:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882668.908382:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908390:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908406:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa285a00300) 00010000:00010000:2.0:1787882668.908416:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787882668.908420:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908425:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5dfd17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908523:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908529:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908534:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908861:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882668.908865:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908898:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908908:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:2.0:1787882668.908911:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787882668.908918:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfc61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843372 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908930:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfc61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843372 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908939:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfc61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843372 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.908978:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfc61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843372 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.908991:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af7f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730564007296:192.168.206.21@tcp:105: 00000100:00100000:2.0:1787882668.909072:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7171840 going to sleep for 11 seconds 00000100:00100000:2.0:1787882668.913114:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af7f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874730564007296:192.168.206.21@tcp:105: 00010000:00010000:2.0:1787882668.913143:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913153:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5dfc5a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913182:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5dfd1e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913195:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5dfd1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913204:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5dfd1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913215:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5dfd1e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913221:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5dfd1e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913227:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5dfd1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913247:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882668.913251:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5dfd1e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913258:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5dfd1e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913270:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:2.0:1787882668.913273:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787882668.913277:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5dfd1e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913283:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5dfd1e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913293:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfd10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913299:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfd10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913304:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfd10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913309:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791be00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882668.913311:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfd10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913316:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfd10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913331:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:2.0:1787882668.913333:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787882668.913336:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfd10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.913341:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5dfd10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.913583:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:11653:x1874730542005760:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 14372us (14525us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787882668.913595:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 230 00000020:00080000:2.0:1787882668.913601:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787882668.913780:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882668.913785:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882668.914322:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787882668.914331:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787882668.915713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.915788:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542006016 00000100:00100000:0.0:1787882668.915797:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542006016 00000100:00100000:0.0:1787882668.915847:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:0.0:1787882668.915857:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:11652:x1874730542006016:12345-192.168.206.21@tcp:49:lfs.0 00000100:00100000:0.0:1787882668.916011:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:11652:x1874730542006016:12345-192.168.206.21@tcp:49:lfs.0 Request processed in 155us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882668.916019:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:3.0:1787882668.918955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.919072:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542006272 00000100:00100000:0.0:1787882668.919081:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542006272 00000100:00100000:0.0:1787882668.919134:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:0.0:1787882668.919152:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284beb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+23:11653:x1874730542006272:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787882668.920397:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787882668.920525:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787882668.920727:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfd25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.920745:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfd25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.920756:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfd25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.920765:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfd25 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.920772:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfd25 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.920778:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfd25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.920804:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787882668.920966:0:11677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882668.920973:0:11677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfd25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.920980:0:11677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882668.920984:0:11677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfd25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.921004:0:11677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfd25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.921017:0:11677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fa283291200) 00010000:00010000:3.0:1787882668.921020:0:11677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787882668.921025:0:11677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfd25 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.921031:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5dfd25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882668.921046:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882668.921048:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882668.921050:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882668.921213:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284beb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+25:11653:x1874730542006272:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 1983us (2186us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787882668.921231:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 62 00000020:00080000:1.0:1787882668.921237:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787882668.932020:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882668.932103:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542006528 00000100:00100000:3.0:1787882668.932113:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542006528 00000100:00100000:3.0:1787882668.932184:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 231 00000100:00100000:3.0:1787882668.932195:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+25:11652:x1874730542006528:12345-192.168.206.21@tcp:58:lfs.0 00000040:00080000:3.0:1787882668.932460:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787882668.932546:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+25:11652:x1874730542006528:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 352us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882668.932554:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 231 00000100:00100000:3.0:1787882668.964596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882668.964783:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542006656 00000100:00100000:0.0:1787882668.964794:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542006656 00000100:00100000:0.0:1787882668.964852:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 232 00000100:00100000:0.0:1787882668.964861:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+25:11655:x1874730542006656:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1787882668.964918:0:6733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882668.964938:0:6733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfd2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8433aa expref: -99 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.964997:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfd33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.965025:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfd33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.965036:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfd33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.965050:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfd3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.965056:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfd3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.965062:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfd3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.965349:0:6733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.965360:0:6733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84336b expref: 26 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.965368:0:6733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.965400:0:6733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84336b expref: 26 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882668.965414:0:6733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84336b expref: 26 pid: 6733 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882668.965440:0:6733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730564007424:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882668.965526:0:6733:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749780 going to sleep for 11 seconds 00000100:00100000:0.0:1787882668.972629:0:6733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6733:1874730564007424:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882668.972660:0:6733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882668.973936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882668.974202:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542006912 00000100:00100000:2.0:1787882668.974211:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542006912 00000100:00100000:2.0:1787882668.974268:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:2.0:1787882668.974279:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:5608:x1874730542006912:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787882668.974520:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:5608:x1874730542006912:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 242us (588us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787882668.974527:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:1.0:1787882668.977951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882668.978094:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542007040 00000100:00100000:2.0:1787882668.978104:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542007040 00010000:00010000:2.0:1787882668.978158:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84336b expref: 28 pid: 6733 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882668.978202:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:2.0:1787882668.978213:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d852050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:2357:x1874730542007040:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882668.978229:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882668.978251:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84336b expref: 28 pid: 6733 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.978265:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84336b expref: 28 pid: 6733 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.978288:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6200/0xf4731e8a7c5dfc4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84336b expref: 28 pid: 6733 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.978304:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:2.0:1787882668.978310:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.978318:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.978325:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882668.978355:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787882668.978475:0:6733:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978483:0:6733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882668.978525:0:6733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787882668.978530:0:6733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787882668.978561:0:6733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978574:0:6733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978583:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfd33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978589:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfd33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978594:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfd33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978600:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882668.978604:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfd33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978622:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfd33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978633:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:1.0:1787882668.978635:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882668.978639:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfd33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978645:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9800/0xf4731e8a7c5dfd33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978655:0:6733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfd3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978662:0:6733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfd3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978668:0:6733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfd3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978683:0:6733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882668.978686:0:6733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfd3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978691:0:6733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfd3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978698:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fa289160400) 00010000:00010000:1.0:1787882668.978701:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882668.978703:0:6733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfd3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978719:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfd3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978755:0:6733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8600/0xf4731e8a7c5dfd2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433aa expref: 28 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978769:0:6733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433aa expref: 27 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882668.978776:0:6733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:1.0:1787882668.978778:0:6733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787882668.978781:0:6733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9400, rc 0) 00000100:00100000:2.0:1787882668.978828:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d852050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+27:2357:x1874730542007040:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 616us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882668.978836:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:1.0:1787882668.979849:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:11655:x1874730542006656:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 14981us (15255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882668.979859:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 232 00010000:00010000:0.0:1787882669.162173:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787882669.420487:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1787882669.420507:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1787882669.420514:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:1.0:1787882669.794287:0:12628:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787882669.794295:0:12628:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787882669.794420:0:12628:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787882669.794428:0:12628:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787882669.931040:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787882669.931053:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787882669.931109:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787882669.931116:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787882669.931841:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af6b6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730564007552:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787882669.931974:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882669.939287:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af6b6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1874730564007552:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787882669.940501:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882669.940546:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542007168 00000100:00100000:1.0:1787882669.940556:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542007168 00000100:00100000:1.0:1787882669.940615:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 233 00000100:00100000:1.0:1787882669.940627:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:11668:x1874730542007168:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787882669.940663:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787882669.940783:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:11668:x1874730542007168:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 157us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882669.940790:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 233 00000100:00100000:3.0:1787882669.948081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882669.950106:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542007424 00000100:00100000:0.0:1787882669.950118:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542007424 00000100:00100000:0.0:1787882669.950176:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 234 00000100:00100000:0.0:1787882669.950188:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+26:11668:x1874730542007424:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882669.950207:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882669.950227:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5dfd48 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8433b1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882669.950329:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5dfd4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882669.950344:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5dfd4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882669.950358:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5dfd4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882669.950369:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787882669.950499:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d8800/0xf4731e8a7c5dfd48 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433b1 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882669.950527:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5dfd4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433b1 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882669.950535:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:0.0:1787882669.950538:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882669.950541:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9a00, rc 0) 00000100:00100000:0.0:1787882669.950596:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:11668:x1874730542007424:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 410us (2522us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1787882669.950603:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 234 00000100:00100000:1.0:1787882669.958111:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882669.958184:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542007680 00000100:00100000:3.0:1787882669.958195:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542007680 00000100:00100000:2.0:1787882669.960418:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882669.960497:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 235 00000100:00100000:2.0:1787882669.960511:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:11668:x1874730542007680:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787882669.960598:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882669.960615:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882669.960627:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882669.960812:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882669.960820:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882669.960827:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882669.960833:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791bc00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882669.960837:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882669.960844:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882669.960856:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:2.0:1787882669.960859:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787882669.960863:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882669.960888:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882669.961041:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:11668:x1874730542007680:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 534us (2937us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787882669.961049:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 235 00000040:00080000:1.0:1787882669.961107:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787882669.961112:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787882669.961122:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542007808 00000100:00100000:0.0:1787882669.961129:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542007808 00000100:00100000:0.0:1787882669.961170:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:0.0:1787882669.961178:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:2357:x1874730542007808:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882669.961187:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882669.961201:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9a00/0xf4731e8a7c5dfd4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433b1 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882669.961212:0:8466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:0.0:1787882669.961215:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882669.961237:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:2357:x1874730542007808:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 60us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882669.961244:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000040:00080000:1.0:1787882669.961650:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787882669.961660:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787882669.964828:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882669.965025:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542008064 00000100:00100000:2.0:1787882669.965035:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542008064 00000100:00100000:2.0:1787882669.965091:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:2.0:1787882669.965102:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+28:11668:x1874730542008064:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787882669.965682:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:11668:x1874730542008064:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 579us (863us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787882669.965692:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00010000:00010000:0.0:1787882670.186460:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882671.211086:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882671.402152:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564007680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882671.402223:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882671.402442:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564007680 00000100:00100000:0.0:1787882671.402450:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564007680 00000100:00100000:0.0:1787882671.402540:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787882671.402551:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564007680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882671.402585:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882671.402631:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564007680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882671.402638:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1787882671.402712:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882671.402741:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787882671.402748:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1787882671.402767:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2c1156300, transno 4294967310 00000100:00100000:3.0:1787882671.405071:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730564007808:0@lo:400:kworker.0 00000100:00100000:3.0:1787882671.405157:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882671.405239:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564007808 00000100:00100000:0.0:1787882671.405247:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564007808 00000100:00100000:0.0:1787882671.405295:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787882671.405304:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730564007808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882671.405468:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564007680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882671.405493:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bfaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730564008192:0@lo:400:kworker.0 00000100:00100000:2.0:1787882671.405526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882671.405570:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564008192 00000100:00100000:2.0:1787882671.405575:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564008192 00000100:00100000:2.0:1787882671.405619:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787882671.405626:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730564008192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882671.405692:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730564008192:12345-0@lo:400:kworker.0 Request processed in 67us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882671.405701:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1787882671.405731:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882671.405758:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bfaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730564008192:0@lo:400:kworker.0 00000100:00100000:0.0:1787882671.406005:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730564007808:12345-0@lo:400:kworker.0 Request processed in 701us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882671.406013:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787882671.406089:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730564007936:0@lo:400:kworker.0 00000100:00100000:2.0:1787882671.406120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882671.406150:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787882671.406156:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bfaf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564008064:0@lo:400:kworker.0 00000100:00100000:2.0:1787882671.406179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882671.406204:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564007936 00000100:00100000:2.0:1787882671.406208:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564007936 00000100:00100000:2.0:1787882671.406230:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564008064 00000100:00100000:2.0:1787882671.406232:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564008064 00000100:00100000:2.0:1787882671.406254:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787882671.406260:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730564007936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882671.406296:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730564007936:12345-0@lo:400:kworker.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882671.406302:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787882671.406316:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787882671.406322:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564008064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882671.406349:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564008064:12345-0@lo:400:kworker.0 Request processed in 28us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882671.406354:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1787882671.406370:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882671.406387:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bfaf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564008064:0@lo:400:kworker.0 00000100:00100000:2.0:1787882671.406409:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730564007936:0@lo:400:kworker.0 00000100:00100000:3.0:1787882671.406496:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730564007808:0@lo:400:kworker.0 00000100:00100000:3.0:1787882671.406646:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bfaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564008320:0@lo:400:kworker.0 00000100:00100000:3.0:1787882671.406695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882671.406784:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564008320 00000100:00100000:2.0:1787882671.406788:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564008320 00000100:00100000:2.0:1787882671.406842:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787882671.406850:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1874730564008320:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787882671.406995:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787882671.407177:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1874730564008320:12345-0@lo:400:kworker.0 Request processed in 327us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882671.407185:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787882671.407265:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bfaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564008320:0@lo:400:kworker.0 00000040:00080000:2.0:1787882671.560346:0:12680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787882671.560354:0:12680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787882671.560408:0:12680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787882671.560414:0:12680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787882671.737675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882671.738534:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542008320 00000100:00100000:2.0:1787882671.738546:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542008320 00000100:00100000:2.0:1787882671.738647:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 236 00000100:00080000:0.0:1787882671.738653:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882671.738670:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+29:11688:x1874730542008320:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882671.738696:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882671.738728:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8433b8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.738831:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a200/0xf4731e8a7c5dfd6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.738857:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a200/0xf4731e8a7c5dfd6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.738884:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a200/0xf4731e8a7c5dfd6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882671.738914:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787882671.739050:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433b8 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.739065:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a200/0xf4731e8a7c5dfd6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433b8 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.739073:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:2.0:1787882671.739076:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787882671.739079:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a200, rc 0) 00000100:00100000:2.0:1787882671.739145:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:11688:x1874730542008320:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 489us (1492us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787882671.739153:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 236 00000100:00100000:3.0:1787882671.751531:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882671.751653:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542008448 00000100:00100000:2.0:1787882671.751672:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542008448 00000100:00100000:2.0:1787882671.751741:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 237 00000100:00100000:2.0:1787882671.751752:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:11688:x1874730542008448:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:2.0:1787882671.751819:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.751838:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.751849:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.751905:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.751926:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.751934:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.751941:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791aa00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882671.751946:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.751955:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.751969:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:2.0:1787882671.751973:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787882671.752113:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882671.752122:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882671.752187:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:11688:x1874730542008448:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 437us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882671.752194:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 237 00000100:00100000:0.0:1787882671.848497:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882671.848706:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542008576 00000100:00100000:1.0:1787882671.848716:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542008576 00000100:00100000:1.0:1787882671.848790:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00100000:1.0:1787882671.848800:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730542008576:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:1.0:1787882671.848828:0:6709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882671.848848:0:6709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfd80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8433bf expref: -99 pid: 6709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787882671.848916:0:6709:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a90ecab, atime: 0x6a90ecaa, ctime: 0x6a90ecab, blocks: 0xb 00010000:00010000:1.0:1787882671.848937:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=387s v=(0 0) 00010000:00010000:1.0:1787882671.848942:0:6709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882671.848963:0:6709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfd80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433bf expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882671.848981:0:6709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfd80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433bf expref: 8 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882671.848995:0:6709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6800, rc 0) 00000100:00100000:1.0:1787882671.849053:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730542008576:12345-192.168.206.21@tcp:101:cat.0 Request processed in 254us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882671.849059:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00080000:0.0:1787882671.849423:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882671.852402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882671.852565:0:6715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542008704 00000100:00100000:2.0:1787882671.852574:0:6715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542008704 00002000:00100000:2.0:1787882671.852624:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9fa29d8a1c00 x1874730542008704/t0(0) o3->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:402/0 lens 488/0 e 0 to 0 dl 1787882682 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787882671.852634:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa29d8a1c00 with x1874730542008704 ext(0->4095) 00002000:00010000:2.0:1787882671.852652:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa29d8a1c00 00000100:00100000:2.0:1787882671.852696:0:6715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:2.0:1787882671.852705:0:6715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2357:x1874730542008704:12345-192.168.206.21@tcp:3:cat.0 00000100:00100000:2.0:1787882671.852922:0:6715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2357:x1874730542008704:12345-192.168.206.21@tcp:3:cat.0 Request processed in 217us (529us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787882671.852929:0:6715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00002000:00100000:2.0:1787882671.852936:0:6715:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9fa29d8a1c00 x1874730542008704/t0(0) o3->2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9@192.168.206.21@tcp:402/0 lens 488/4536 e 0 to 0 dl 1787882682 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787882671.852945:0:6715:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fa29d8a1c00 with x1874730542008704 ext(0->4095) 00002000:00010000:2.0:1787882671.852947:0:6715:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fa29d8a1c00 00000100:00100000:2.0:1787882671.914497:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564008448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787882671.914808:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882671.919376:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564008448 00000100:00100000:1.0:1787882671.919393:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564008448 00000100:00100000:1.0:1787882671.920192:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787882671.920209:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874730564008448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787882671.920260:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882671.920349:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874730564008448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (5617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882671.920356:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787882671.920461:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564008448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787882672.234096:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882672.811960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882672.812001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882672.812028:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882672.812047:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882672.812088:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882672.812120:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542009216 00000100:00100000:2.0:1787882672.812129:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542009216 00000100:00100000:2.0:1787882672.812184:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542009088 00000100:00100000:2.0:1787882672.812187:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542009088 00000100:00100000:2.0:1787882672.812219:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:2.0:1787882672.812229:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730542009216:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882672.812298:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+8:2356:x1874730542009216:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 70us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882672.812313:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:2.0:1787882672.812336:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:2.0:1787882672.812342:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b986ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2356:x1874730542009088:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882672.812369:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b986ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2356:x1874730542009088:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882672.812375:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:2.0:1787882672.812393:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542008832 00000100:00100000:2.0:1787882672.812397:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542008832 00000100:00100000:2.0:1787882672.812418:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 299 00000100:00100000:2.0:1787882672.812425:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2356:x1874730542008832:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882672.812451:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2356:x1874730542008832:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882672.812457:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 299 00000100:00100000:2.0:1787882672.812488:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542008960 00000100:00100000:2.0:1787882672.812492:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542008960 00000100:00100000:2.0:1787882672.812514:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542009344 00000100:00100000:2.0:1787882672.812517:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542009344 00000100:00100000:2.0:1787882672.812539:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 163 00000100:00100000:2.0:1787882672.812545:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:2356:x1874730542008960:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882672.812574:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+31:2356:x1874730542008960:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882672.812581:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 163 00000100:00100000:2.0:1787882672.812594:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00100000:2.0:1787882672.812600:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2356:x1874730542009344:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882672.812636:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2356:x1874730542009344:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882672.812643:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00080000:2.0:1787882672.812676:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787882672.812680:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787882673.066138:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787882673.066151:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787882673.066282:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787882673.066291:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787882673.259568:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787882674.040331:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1787882674.040350:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1787882674.041026:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00080000:2.0:1787882674.044038:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1787882674.044068:0:5873:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fa2b7171d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1787882674.044073:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2b0886600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fa2b71713c0 00000020:00080000:2.0:1787882674.044077:0:5873:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fa2b0886e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fa287a54400 00000020:00080000:2.0:1787882674.044117:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1787882674.047763:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787882674.047996:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1787882674.283013:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882675.307737:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882676.332227:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882676.522798:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bfaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564008576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882676.522892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882676.522971:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564008960:0@lo:400:kworker.0 00000100:00100000:1.0:1787882676.522988:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730564008832:0@lo:400:kworker.0 00000100:00100000:2.0:1787882676.523004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882676.523016:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730564008704:0@lo:400:kworker.0 00000100:00100000:2.0:1787882676.523043:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564008960 00000100:00100000:1.0:1787882676.523043:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882676.523049:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564008960 00000100:00100000:2.0:1787882676.523092:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787882676.523101:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564008960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882676.523137:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564008704 00000100:00100000:1.0:1787882676.523141:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564008704 00000100:00100000:2.0:1787882676.523146:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564008960:12345-0@lo:400:kworker.0 Request processed in 47us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882676.523154:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787882676.523161:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1787882676.523166:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730564008704:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787882676.523178:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882676.523198:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882676.523198:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3307:x1874730564008704:12345-0@lo:400:kworker.0 Request processed in 31us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882676.523205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787882676.523222:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564008832 00000100:00100000:2.0:1787882676.523230:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564008832 00000100:00100000:2.0:1787882676.523253:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787882676.523253:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730564008704:0@lo:400:kworker.0 00000100:00100000:2.0:1787882676.523258:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730564008832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882676.523288:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730564008832:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882676.523294:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787882676.523322:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730564008832:0@lo:400:kworker.0 00000100:00100000:2.0:1787882676.523341:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564008960:0@lo:400:kworker.0 00000100:00100000:2.0:1787882676.523374:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564008576 00000100:00100000:2.0:1787882676.523378:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564008576 00000100:00100000:2.0:1787882676.523414:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787882676.523420:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564008576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787882676.523443:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882676.523816:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787882676.523825:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564009216:0@lo:400:kworker.0 00000100:00100000:3.0:1787882676.523851:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882676.523896:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564009216 00000100:00100000:3.0:1787882676.523900:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564009216 00000100:00100000:3.0:1787882676.523924:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787882676.523931:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730564009216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882676.523960:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730564009216:12345-0@lo:400:kworker.0 Request processed in 30us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882676.523966:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787882676.524043:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787882676.524048:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2c1156a00, transno 4294967322 00000004:00080000:3.0:1787882676.524058:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787882676.524073:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564009216:0@lo:400:kworker.0 00000100:00080000:1.0:1787882676.524982:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882676.524987:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882676.525171:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730564009088:0@lo:400:kworker.0 00000100:00100000:0.0:1787882676.525219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882676.525465:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564009088 00000100:00100000:1.0:1787882676.525471:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564009088 00000100:00100000:1.0:1787882676.525520:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787882676.525528:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730564009088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882676.525576:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874730564009088:12345-0@lo:400:kworker.0 Request processed in 49us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882676.525583:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:3.0:1787882676.526126:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882676.530817:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564008576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7383us (7935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882676.530832:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787882676.531428:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bfaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564008576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882676.531468:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730564009088:0@lo:400:kworker.0 00000100:00100000:0.0:1787882676.689476:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882676.689601:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542009472 00000100:00100000:1.0:1787882676.689612:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542009472 00000100:00100000:1.0:1787882676.689701:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 238 00000100:00100000:1.0:1787882676.689712:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:11333:x1874730542009472:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787882676.689810:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:11333:x1874730542009472:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 Request processed in 100us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882676.689818:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 238 00000100:00080000:3.0:1787882676.690131:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882676.704605:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882676.704861:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542009728 00000100:00100000:0.0:1787882676.704914:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542009728 00000100:00100000:0.0:1787882676.705030:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:0.0:1787882676.705043:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:11333:x1874730542009728:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787882676.705832:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:11333:x1874730542009728:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 787us (1236us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787882676.705842:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:1.0:1787882677.010601:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882677.010752:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542009856 00000100:00100000:2.0:1787882677.010766:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542009856 00000100:00080000:1.0:1787882677.010927:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882677.011017:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 239 00000100:00100000:2.0:1787882677.011030:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:12139:x1874730542009856:12345-192.168.206.21@tcp:101:lsof.0 00010000:00010000:2.0:1787882677.011060:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882677.011090:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8433c6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882677.011188:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882677.011224:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882677.011240:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882677.011573:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787882677.011579:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882677.011681:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882677.011716:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791aa00/0xf4731e8a7c5dfd87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433c6 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882677.011735:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433c6 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882677.011746:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00600) 00010000:00010000:2.0:1787882677.011750:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787882677.011753:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791bc00, rc 0) 00000100:00100000:2.0:1787882677.011841:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:12139:x1874730542009856:12345-192.168.206.21@tcp:101:lsof.0 Request processed in 814us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882677.011849:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 239 00000100:00100000:1.0:1787882677.034463:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787882677.034522:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2a998f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564009344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787882677.034612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882677.034806:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564009344 00000100:00100000:0.0:1787882677.034817:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564009344 00000100:00100000:0.0:1787882677.034904:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787882677.034916:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564009344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787882677.034961:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882677.035027:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564009344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882677.035035:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787882677.035171:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2a998f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564009344:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787882677.357309:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882677.926198:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882677.926312:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882677.926357:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882677.926408:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882677.926444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882677.926480:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542010240 00000100:00100000:1.0:1787882677.926492:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542010240 00000100:00100000:1.0:1787882677.926563:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542010368 00000100:00100000:1.0:1787882677.926566:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542010368 00000100:00100000:1.0:1787882677.926589:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:1.0:1787882677.926601:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bfaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2356:x1874730542010240:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882677.926712:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bfaf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2356:x1874730542010240:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 112us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882677.926737:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:1.0:1787882677.926756:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:1.0:1787882677.926763:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730542010368:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882677.926794:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2356:x1874730542010368:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882677.926799:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00080000:1.0:1787882677.926822:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882677.926827:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787882677.926839:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542010496 00000100:00100000:1.0:1787882677.926843:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542010496 00000100:00100000:1.0:1787882677.926932:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542010112 00000100:00100000:1.0:1787882677.926936:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542010112 00000100:00100000:1.0:1787882677.926957:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 168 00000100:00100000:1.0:1787882677.926964:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:2356:x1874730542010496:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882677.926996:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:2356:x1874730542010496:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882677.927002:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 168 00000100:00100000:1.0:1787882677.927014:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 169 00000100:00100000:1.0:1787882677.927020:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:2356:x1874730542010112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882677.927053:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:2356:x1874730542010112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882677.927059:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 169 00000100:00100000:2.0:1787882677.929175:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542009984 00000100:00100000:2.0:1787882677.929193:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542009984 00000100:00100000:2.0:1787882677.929392:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 301 00000100:00100000:2.0:1787882677.930245:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2356:x1874730542009984:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882677.930609:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2356:x1874730542009984:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1207us (4424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882677.930620:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 301 00010000:00010000:0.0:1787882678.378273:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787882679.139274:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1787882679.139293:0:5873:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787882679.139345:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787882679.139354:0:5890:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1787882679.403663:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787882680.329471:0:12883:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:04:38 (1787882678) 00010000:00010000:2.0:1787882680.427212:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882681.451332:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882681.642334:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787882681.642366:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564009472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882681.642516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882681.642655:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564009472 00000100:00100000:1.0:1787882681.642666:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564009472 00000100:00080000:0.0:1787882681.642804:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787882681.642831:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787882681.643056:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2a998f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564009472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882681.643105:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882681.643280:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2a998f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564009472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 438us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882681.643289:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787882681.644617:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b622c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730564009728:0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.644659:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b622d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730564009984:0@lo:400:kworker.0 00000100:00100000:1.0:1787882681.644694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882681.644825:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730564009856:0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.646613:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882681.646721:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564009728 00000100:00100000:2.0:1787882681.646741:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564009728 00000100:00100000:2.0:1787882681.646798:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564009856 00000100:00100000:2.0:1787882681.646801:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564009856 00000100:00100000:2.0:1787882681.646838:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787882681.646862:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730564009728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.646967:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730564009728:12345-0@lo:400:kworker.0 Request processed in 107us (2274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882681.646974:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787882681.647001:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787882681.647007:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730564009856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.647039:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730564009856:12345-0@lo:400:kworker.0 Request processed in 32us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882681.647045:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1787882681.647072:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882681.647085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882681.647132:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787882681.647155:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730564009600:0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.647196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882681.647221:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b622df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564010112:0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.647248:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882681.647278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564009600 00000100:00100000:2.0:1787882681.647282:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564009600 00000100:00100000:2.0:1787882681.647312:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787882681.647318:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730564009600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.647351:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d809450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730564009600:12345-0@lo:400:kworker.0 Request processed in 34us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882681.647357:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787882681.647403:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564010112 00000100:00100000:2.0:1787882681.647407:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564010112 00000100:00100000:2.0:1787882681.647439:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787882681.647446:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564010112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.647473:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564010112:12345-0@lo:400:kworker.0 Request processed in 28us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882681.647478:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1787882681.647498:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787882681.647522:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730564009600:0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.647534:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b622df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564010112:0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.647566:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564009984 00000100:00100000:2.0:1787882681.647569:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564009984 00000100:00100000:2.0:1787882681.647594:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787882681.647600:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730564009984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.647656:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730564009984:12345-0@lo:400:kworker.0 Request processed in 56us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882681.647663:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1787882681.647680:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882681.647697:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b622d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730564009984:0@lo:400:kworker.0 00000100:00100000:2.0:1787882681.647721:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b622f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730564009856:0@lo:400:kworker.0 00000100:00100000:0.0:1787882681.651584:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564009472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787882681.653131:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b622c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730564009728:0@lo:400:kworker.0 00000100:00100000:2.0:1787882682.155783:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564010240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787882682.155854:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882682.156248:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564010240 00000100:00100000:0.0:1787882682.156256:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564010240 00000100:00100000:0.0:1787882682.156342:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787882682.156352:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564010240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787882682.156391:0:6712:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882682.156451:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af7e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564010240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882682.156459:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787882682.156819:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf48c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564010240:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787882682.480949:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882683.041669:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882683.041717:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882683.041844:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542010624 00000100:00100000:2.0:1787882683.041858:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542010624 00000100:00100000:2.0:1787882683.041962:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 303 00000100:00100000:2.0:1787882683.041975:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2358:x1874730542010624:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882683.042075:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2358:x1874730542010624:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 103us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882683.042084:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 303 00000100:00100000:1.0:1787882683.042459:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882683.042484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882683.042514:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882683.042558:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542011136 00000100:00100000:0.0:1787882683.042567:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542011136 00000100:00100000:2.0:1787882683.042593:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542010752 00000100:00100000:2.0:1787882683.042610:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542010752 00000100:00100000:0.0:1787882683.042666:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 173 00000100:00100000:2.0:1787882683.042678:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 174 00000100:00100000:0.0:1787882683.042686:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:2358:x1874730542011136:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882683.042697:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:2358:x1874730542010752:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882683.043135:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:2358:x1874730542011136:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 456us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882683.043150:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 173 00000100:00080000:0.0:1787882683.043176:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882683.044897:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:2358:x1874730542010752:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 2173us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882683.044913:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 174 00000100:00100000:3.0:1787882683.055331:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542010880 00000100:00100000:3.0:1787882683.055354:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542010880 00000100:00100000:2.0:1787882683.056378:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542011008 00000100:00100000:2.0:1787882683.056394:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542011008 00000100:00080000:0.0:1787882683.056429:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787882683.056440:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882683.056485:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 87 00000100:00100000:2.0:1787882683.056509:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730542010880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882683.056978:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:1.0:1787882683.056990:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2358:x1874730542011008:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882683.057105:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2358:x1874730542010880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 597us (15386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882683.057114:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 87 00000100:00100000:1.0:1787882683.057305:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2358:x1874730542011008:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 316us (14787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882683.057313:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 88 00000040:00080000:0.0:1787882683.307195:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787882683.307204:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787882683.308984:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787882683.308997:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787882683.501766:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882683.837909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882683.838007:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542011392 00000100:00100000:1.0:1787882683.838029:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542011392 00000100:00100000:1.0:1787882683.838090:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:1.0:1787882683.838101:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+18:12361:x1874730542011392:12345-192.168.206.21@tcp:35:umount.0 00000100:00100000:1.0:1787882683.839176:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:12361:x1874730542011392:12345-192.168.206.21@tcp:35:umount.0 Request processed in 1071us (1305us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787882683.839187:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:0.0:1787882683.850222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882683.850321:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542011648 00000100:00100000:3.0:1787882683.850331:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542011648 00000100:00100000:3.0:1787882683.850723:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:3.0:1787882683.850735:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+19:12361:x1874730542011648:12345-192.168.206.21@tcp:35:umount.0 00000100:00100000:3.0:1787882683.851148:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:12361:x1874730542011648:12345-192.168.206.21@tcp:35:umount.0 Request processed in 415us (934us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787882683.851157:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:0.0:1787882683.857777:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882683.857904:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542011904 00000100:00100000:2.0:1787882683.857914:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542011904 00000100:00100000:2.0:1787882683.857968:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:2.0:1787882683.857979:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa284be9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+20:12361:x1874730542011904:12345-192.168.206.21@tcp:35:umount.0 00000100:00100000:2.0:1787882683.858604:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa284be9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:12361:x1874730542011904:12345-192.168.206.21@tcp:35:umount.0 Request processed in 615us (824us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787882683.858613:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:0.0:1787882683.861104:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882683.861187:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542012160 00000100:00100000:1.0:1787882683.861196:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542012160 00000100:00100000:1.0:1787882683.861252:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:1.0:1787882683.861262:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:12361:x1874730542012160:12345-192.168.206.21@tcp:35:umount.0 00000100:00100000:1.0:1787882683.861664:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:12361:x1874730542012160:12345-192.168.206.21@tcp:35:umount.0 Request processed in 402us (567us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1787882683.861671:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:0.0:1787882683.869700:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882683.869741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882683.869770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882683.869804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882683.869824:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542012288 00000100:00100000:1.0:1787882683.869833:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542012288 00000100:00100000:2.0:1787882683.869897:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542012544 00000100:00100000:2.0:1787882683.869902:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542012544 00000100:00100000:1.0:1787882683.869917:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542012416 00000100:00100000:1.0:1787882683.869919:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542012416 00000100:00100000:2.0:1787882683.869926:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:2.0:1787882683.869934:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+15:2357:x1874730542012288:12345-192.168.206.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787882683.869941:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1787882683.869946:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+15:2357:x1874730542012544:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882683.869949:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882683.869952:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882683.869967:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5dee06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f51 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.869967:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b67ce800/0xf4731e8a7c5deff0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84301c expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882683.869982:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787882683.869982:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882683.870062:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542012928 00000100:00100000:3.0:1787882683.870067:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542012928 00000100:00100000:3.0:1787882683.870097:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:3.0:1787882683.870103:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+7:2355:x1874730542012928:12345-192.168.206.21@tcp:9:umount.0 00000020:00000080:3.0:1787882683.870125:0:6710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5df346 00000020:00010000:3.0:1787882683.870133:0:6710:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fa2bff28800: total 0 00000100:00080000:3.0:1787882683.870137:0:6710:0:(import.c:65:import_set_state_nolock()) ffff9fa2bff2c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787882683.870169:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787882683.870495:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+13:2357:x1874730542012544:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 547us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882683.870502:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1787882683.870527:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:1.0:1787882683.870534:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9876300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:2357:x1874730542012416:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787882683.870542:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882683.870553:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2813fea00/0xf4731e8a7c5ded6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f19 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.870563:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882683.872236:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:2357:x1874730542012288:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 2292us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882683.872248:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000020:00010000:2.0:1787882683.872289:0:11677:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fa2bff28800: total 0 00010000:00010000:2.0:1787882683.872331:0:11677:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa2bff28800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787882683.872404:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5df6e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431f1 expref: 5 pid: 6710 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882683.872655:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000653b3581/0xf4731e8a7c5dfd80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433bf expref: 4 pid: 6709 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882683.872673:0:11677:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa2bff28800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787882683.872685:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882683.872687:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882683.872689:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882683.875841:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+2:2355:x1874730542012928:12345-192.168.206.21@tcp:9:umount.0 Request processed in 5724us (6023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882683.875889:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:1.0:1787882683.880136:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9876300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2357:x1874730542012416:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 9592us (10354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882683.880151:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:0.0:1787882683.886838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882683.887232:0:12080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542013056 00000100:00100000:3.0:1787882683.887241:0:12080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542013056 00000100:00100000:3.0:1787882683.887323:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:3.0:1787882683.887334:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+5:2355:x1874730542013056:12345-192.168.206.21@tcp:9:umount.0 00000020:00000080:3.0:1787882683.887361:0:12080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5df0de 00000100:00080000:3.0:1787882683.887369:0:12080:0:(import.c:65:import_set_state_nolock()) ffff9fa2b623b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787882683.887419:0:12080:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787882683.887697:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+2:2355:x1874730542013056:12345-192.168.206.21@tcp:9:umount.0 Request processed in 363us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882683.887705:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 73 00010000:00010000:0.0:1787882683.888738:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882683.897866:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882683.898157:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542014080 00000100:00100000:2.0:1787882683.898167:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542014080 00000100:00100000:2.0:1787882683.898262:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 240 00000100:00100000:2.0:1787882683.898273:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+22:2355:x1874730542014080:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:2.0:1787882683.898303:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5ded7a 00000020:00010000:2.0:1787882683.898316:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fa2bb1cd800: total 0 00000100:00080000:2.0:1787882683.898320:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9fa2b6466000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787882683.898348:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787882683.898785:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9+21:2355:x1874730542014080:12345-192.168.206.21@tcp:39:umount.0 Request processed in 512us (925us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787882683.898793:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 240 00000020:00010000:1.0:1787882683.898860:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fa2bb1cd800: total 0 00010000:00010000:1.0:1787882683.898918:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa2bb1cd800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787882683.898947:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa2a0727800) 00010000:00010000:1.0:1787882683.898951:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882683.898958:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cea00/0xf4731e8a7c5df060 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843031 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899002:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:1.0:1787882683.899015:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787882683.899021:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5df6a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431dc expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899035:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:1.0:1787882683.899038:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787882683.899042:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5df6cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431ea expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899053:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:1.0:1787882683.899056:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787882683.899059:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9400/0xf4731e8a7c5dfd41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433aa expref: 17 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899071:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00600) 00010000:00010000:1.0:1787882683.899073:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787882683.899076:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5df744 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84320d expref: 16 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899087:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:1.0:1787882683.899089:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787882683.899092:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a200/0xf4731e8a7c5dfd6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433b8 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899104:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:1.0:1787882683.899106:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787882683.899116:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67cf400/0xf4731e8a7c5df3a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843118 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899130:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa285a00b00) 00010000:00010000:1.0:1787882683.899132:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787882683.899136:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5df044 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84302a expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899157:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:1.0:1787882683.899159:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787882683.899163:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7600/0xf4731e8a7c5dfa3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8432e6 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899174:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fa285a00900) 00010000:00010000:1.0:1787882683.899177:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787882683.899180:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5df0b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843046 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899193:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fa2a0727600) 00010000:00010000:1.0:1787882683.899195:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787882683.899199:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6c00/0xf4731e8a7c5dfc61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843372 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899212:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fa289160d00) 00010000:00010000:1.0:1787882683.899214:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787882683.899218:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b67d9c00/0xf4731e8a7c5df760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843214 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899240:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fa285a00700) 00010000:00010000:1.0:1787882683.899247:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787882683.899252:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa280031600/0xf4731e8a7c5df5c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8431a4 expref: 8 pid: 6733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882683.899267:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa2bb1cd800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787882683.899279:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882683.899281:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882683.899283:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787882684.262521:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1787882684.262537:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000001:00080000:1.0:1787882684.262542:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787882684.262549:0:5873:0:(genops.c:885:class_export_put()) final put ffff9fa2bb1cd800/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000020:00000080:1.0:1787882684.262578:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2bb1cd800/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 for lustre-MDT0000 00000020:00000080:1.0:1787882684.262648:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2b6466000 for lustre-MDT0000 00000001:00100000:3.0:1787882684.292763:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000020:00000080:3.0:1787882684.292772:0:7664:0:(genops.c:885:class_export_put()) final put ffff9fa2bff28800/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000020:00000080:1.0:1787882684.292867:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2bff28800/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 for lustre-OST0001 00000020:00000080:1.0:1787882684.294085:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2bff2c800 for lustre-OST0001 00010000:00010000:2.0:1787882684.528642:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787882684.823105:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000020:00000080:3.0:1787882684.823118:0:6737:0:(genops.c:885:class_export_put()) final put ffff9fa2b623d800/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 00000020:00000080:1.0:1787882684.826101:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2b623d800/2ee5b5a1-f1e0-4db2-ad56-96eab228b9a9 for lustre-OST0000 00000020:00000080:1.0:1787882684.829124:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2b623b000 for lustre-OST0000 00010000:00010000:2.0:1787882685.547164:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882685.710097:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882685.710165:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882685.710211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882685.710312:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542014208 00000100:00100000:3.0:1787882685.710325:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542014208 00000100:00100000:3.0:1787882685.710402:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542014464 00000100:00100000:3.0:1787882685.710406:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542014464 00000100:00100000:3.0:1787882685.710418:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542014336 00000100:00100000:3.0:1787882685.710421:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542014336 00000100:00100000:3.0:1787882685.710437:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:3.0:1787882685.710556:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+12:2359:x1874730542014208:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882685.710579:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882685.710615:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5dee4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f66 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882685.710636:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882685.710699:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+11:2359:x1874730542014208:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 252us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882685.710706:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:3.0:1787882685.710727:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:3.0:1787882685.710734:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+10:2359:x1874730542014464:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882685.710743:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882685.710761:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b67d9e00/0xf4731e8a7c5defe9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843015 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882685.710770:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882685.710790:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+9:2359:x1874730542014464:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 56us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882685.710797:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:3.0:1787882685.710987:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:3.0:1787882685.710997:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d850450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+8:2359:x1874730542014336:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882685.711007:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882685.711017:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b7264c00/0xf4731e8a7c5dee53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f90 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882685.711027:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882685.711047:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d850450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+7:2359:x1874730542014336:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 52us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882685.711053:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:3.0:1787882685.727432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882685.728010:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542014720 00000100:00100000:0.0:1787882685.728025:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542014720 00000100:00100000:0.0:1787882685.728135:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 241 00000100:00100000:0.0:1787882685.728149:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+6:2355:x1874730542014720:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:0.0:1787882685.728207:0:5845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dee61 00000020:00010000:0.0:1787882685.728219:0:5845:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fa2c159e000: total 0 00000100:00080000:0.0:1787882685.728225:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9fa2c159e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787882685.728266:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787882685.728793:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e19aa4d4-406f-42d0-a5c3-03793bedba3c+5:2355:x1874730542014720:12345-192.168.206.21@tcp:39:umount.0 Request processed in 644us (1373us total) trans 4294967526 rc 0/0 00000100:00080000:2.0:1787882685.730263:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1787882685.731071:0:11678:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fa2c159e000: total 0 00010000:00010000:1.0:1787882685.731141:0:11678:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa2c159e000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787882685.731190:0:11678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a00600) 00010000:00010000:1.0:1787882685.731195:0:11678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787882685.731213:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791bc00/0xf4731e8a7c5dfd8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433c6 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882685.731247:0:11678:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa2c159e000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787882685.731259:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882685.731262:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882685.731281:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882685.732048:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 241 00000100:00100000:0.0:1787882685.755773:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882685.756017:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542014976 00000100:00100000:3.0:1787882685.756030:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542014976 00000100:00100000:3.0:1787882685.756097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 304 00000100:00100000:3.0:1787882685.756109:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+7:2355:x1874730542014976:12345-192.168.206.21@tcp:251:umount.0 00000020:00000080:3.0:1787882685.756169:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5ded57 00000020:00010000:3.0:1787882685.756180:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fa2bff7b800: total 0 00000100:00080000:3.0:1787882685.756185:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9fa2bff7c800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787882685.756276:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d80b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e20a5c6e-5239-47c9-94f6-23609a5ad5fb+3:2355:x1874730542014976:12345-192.168.206.21@tcp:251:umount.0 Request processed in 168us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882685.756307:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 304 00000020:00010000:1.0:1787882685.756489:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fa2bff7b800: total 0 00010000:00010000:1.0:1787882685.756494:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882685.756558:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa2bff7b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787882685.756612:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2c21c7400/0xf4731e8a7c5dee0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a842f58 expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882685.756629:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa2bff7b800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787882685.756639:0:5831:0:(genops.c:885:class_export_put()) final put ffff9fa2bff7b800/e20a5c6e-5239-47c9-94f6-23609a5ad5fb 00010000:00010000:1.0:1787882685.756655:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882685.756658:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882685.756660:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787882685.757353:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2bff7b800/e20a5c6e-5239-47c9-94f6-23609a5ad5fb for MGS 00000020:00000080:3.0:1787882685.757404:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2bff7c800 for MGS 00010000:00010000:2.0:1787882686.570412:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882686.762855:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787882686.762907:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564010368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882686.762975:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882686.763084:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564010368 00000100:00100000:0.0:1787882686.763093:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564010368 00000100:00100000:0.0:1787882686.763148:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787882686.763158:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564010368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882686.763194:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787882686.763316:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787882686.763529:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730564010880:0@lo:400:kworker.0 00000100:00100000:2.0:1787882686.763617:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730564010496:0@lo:400:kworker.0 00000100:00100000:0.0:1787882686.764172:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af84a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564010368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1013us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882686.764182:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787882686.764223:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730564010624:0@lo:400:kworker.0 00000100:00100000:0.0:1787882686.764309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882686.764348:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564010624 00000100:00100000:0.0:1787882686.764353:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564010624 00000100:00100000:0.0:1787882686.764395:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787882686.764402:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730564010624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882686.764445:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730564010624:12345-0@lo:400:kworker.0 Request processed in 43us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882686.764452:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787882686.764493:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730564010624:0@lo:400:kworker.0 00000100:00100000:3.0:1787882686.766998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882686.770450:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787882686.770470:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730564010752:0@lo:400:kworker.0 00000100:00100000:0.0:1787882686.770495:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564010880 00000100:00100000:0.0:1787882686.770504:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564010880 00000100:00100000:3.0:1787882686.770529:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882686.770567:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564010752 00000100:00100000:0.0:1787882686.770571:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564010752 00000100:00100000:0.0:1787882686.770605:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787882686.770615:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730564010880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882686.770678:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730564010880:12345-0@lo:400:kworker.0 Request processed in 64us (5443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882686.770686:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787882686.770705:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787882686.770716:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730564010752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882686.770793:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730564010752:12345-0@lo:400:kworker.0 Request processed in 81us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882686.770802:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787882686.770819:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730564010752:0@lo:400:kworker.0 00000100:00100000:3.0:1787882686.770836:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730564010880:0@lo:400:kworker.0 00000100:00100000:0.0:1787882686.770970:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564010368:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787882686.773200:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882686.773250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882686.773311:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564011008:0@lo:400:kworker.0 00000100:00100000:3.0:1787882686.773327:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564010496 00000100:00100000:3.0:1787882686.773335:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564010496 00000100:00100000:2.0:1787882686.773351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882686.773382:0:9930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564011008 00000100:00100000:3.0:1787882686.773387:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787882686.773387:0:9930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564011008 00000100:00100000:3.0:1787882686.773402:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730564010496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882686.773433:0:9930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787882686.773443:0:9930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564011008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882686.773453:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d808050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730564010496:12345-0@lo:400:kworker.0 Request processed in 54us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882686.773461:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787882686.773485:0:9930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564011008:12345-0@lo:400:kworker.0 Request processed in 44us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882686.773493:0:9930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1787882686.773522:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787882686.773547:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564011008:0@lo:400:kworker.0 00000100:00100000:2.0:1787882686.773569:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730564010496:0@lo:400:kworker.0 00000100:00100000:2.0:1787882687.277551:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564011136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787882687.277632:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882687.279520:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564011136 00000100:00100000:3.0:1787882687.279534:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564011136 00000100:00100000:3.0:1787882687.279595:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787882687.279606:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564011136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787882687.279639:0:6713:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882687.283635:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf48c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564011136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4020us (5992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882687.283658:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787882687.287301:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564011136:0@lo:13:osp-pre-1-0.0 00000020:01000004:0.0:1787882687.407206:0:13080:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787882687.424118:0:13080:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787882687.424182:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.424200:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.424227:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.424235:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.424266:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787882687.424273:0:13080:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787882687.424302:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787882687.424307:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787882687.424315:0:13080:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787882687.424415:0:13080:0:(import.c:65:import_set_state_nolock()) ffff9fa2a9808000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787882687.424481:0:11677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882687.424490:0:11677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882687.424499:0:11677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265e00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882687.424503:0:11677:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882687.424514:0:11677:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882687.424524:0:11677:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882687.424530:0:11677:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787882687.424533:0:11677:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787882687.424536:0:11677:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787882687.424569:0:11677:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882687.424588:0:11677:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882687.424685:0:11677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882687.424694:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265e00/0xf4731e8a7c5deddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5dede3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882687.424708:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882687.424709:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882687.424720:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882687.424729:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787882687.424754:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730564011392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882687.424846:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882687.425031:0:8466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564011392 00000100:00100000:3.0:1787882687.425041:0:8466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564011392 00000100:00100000:3.0:1787882687.425106:0:8466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787882687.425162:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874730564011264:0@lo:39:umount.0 00000100:00100000:1.0:1787882687.425205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882687.425247:0:6733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564011264 00000100:00100000:1.0:1787882687.425251:0:6733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564011264 00000100:00100000:1.0:1787882687.425286:0:6733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787882687.425295:0:6733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874730564011264:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787882687.425325:0:6733:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5deb66 00000100:00080000:1.0:1787882687.425335:0:6733:0:(import.c:65:import_set_state_nolock()) ffff9fa2b5dee800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787882687.425483:0:8466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3308:x1874730564011392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882687.425497:0:8466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882687.425518:0:8466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b67ce200/0xf4731e8a7c5dede3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5deddc expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882687.425533:0:8466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882687.425593:0:8466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:3308:x1874730564011392:12345-0@lo:103:ldlm_bl.0 Request processed in 477us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882687.425723:0:6733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1874730564011264:12345-0@lo:39:umount.0 Request processed in 430us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882687.425732:0:6733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787882687.425743:0:6733:0:(genops.c:885:class_export_put()) final put ffff9fa2b5dea000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787882687.425776:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787882687.425787:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2b5dea000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787882687.425842:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2b5dee800 for lustre-MDT0000 00000100:00080000:1.0:1787882687.425916:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2a9808000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787882687.425927:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874730564011264:0@lo:39:umount.0 00000100:00100000:0.0:1787882687.426087:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730564011392:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787882687.426115:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787882687.426118:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787882687.426123:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787882687.427217:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427233:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427241:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427248:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427283:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882687.427290:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427298:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427304:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427309:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427330:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787882687.427338:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882687.427341:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787882687.427349:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427355:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882687.427357:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cf800 already unused, calling callback (ffffffffc1bb9c20) 00010000:00010000:0.0:1787882687.427361:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882687.427362:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427368:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882687.427371:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882687.427379:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427381:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787882687.427385:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787882687.427386:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030000/0xf4731e8a7c5deac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882687.427388:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1787882687.427398:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030000/0xf4731e8a7c5deac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427404:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030000/0xf4731e8a7c5deac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427410:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa280030000/0xf4731e8a7c5deac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882687.427420:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1787882687.427423:0:13080:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787882687.427430:0:13080:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1787882687.427435:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882687.427441:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:0.0:1787882687.427458:0:13080:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787882687.427463:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:2.0:1787882687.427468:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787882687.427468:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1787882687.427475:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cf800/0xf4731e8a7c5dedea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5dedf1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787882687.427475:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1787882687.427481:0:13080:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fa2b9a01000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1787882687.427487:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:0.0:1787882687.427488:0:13080:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fa2bb1ca000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1787882687.427491:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882687.427496:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67cfe00 already unused, calling callback (ffffffffc1bb9c20) 00000020:00080000:0.0:1787882687.427496:0:13080:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9fa2c159e000 e19aa4d4-406f-42d0-a5c3-03793bedba3c 192.168.206.21@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787882687.427501:0:13080:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9fa2a99fb370) has exports, disconnecting them 10000000:00010000:2.0:1787882687.427504:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787882687.427507:0:13080:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fa2b9a01000), last request at 1787882686 00010000:00010000:2.0:1787882687.427511:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787882687.427514:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5decd9 10000000:00010000:2.0:1787882687.427518:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882687.427523:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00080000:0.0:1787882687.427533:0:13080:0:(import.c:65:import_set_state_nolock()) ffff9fa2af870800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787882687.427585:0:13080:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa2b9a01000): rc 0 00000020:00000080:0.0:1787882687.427587:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2b9a01000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787882687.427596:0:13080:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fa2bb1ca000), last request at 1787882686 00000020:00000080:0.0:1787882687.427599:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dec0e 00000100:00080000:0.0:1787882687.427615:0:13080:0:(import.c:65:import_set_state_nolock()) ffff9fa2bb1c8000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787882687.427624:0:13080:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa2bb1ca000): rc 0 00000020:00000080:0.0:1787882687.427626:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2bb1ca000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787882687.427634:0:13080:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc0a680ddbae0 00010000:00010000:1.0:1787882687.427653:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00080000:0.0:1787882687.427658:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:1.0:1787882687.427659:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882687.427662:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:1.0:1787882687.427666:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265200 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882687.427669:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787882687.427675:0:13080:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1787882687.427676:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882687.427682:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882687.427687:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787882687.427689:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787882687.427691:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787882687.427711:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882687.427717:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882687.427733:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882687.427739:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265200/0xf4731e8a7c5df013 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5df01a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787882687.427748:0:13080:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:1.0:1787882687.427749:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882687.427752:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280030000/0xf4731e8a7c5deac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787882687.427761:0:13080:0:(import.c:65:import_set_state_nolock()) ffff9fa2af875000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787882687.427768:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280030000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882687.427770:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030000/0xf4731e8a7c5deac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787882687.427772:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787882687.427774:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00010000:00010000:1.0:1787882687.427777:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280030000/0xf4731e8a7c5deac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787882687.427781:0:13080:0:(osp_dev.c:1634:osp_import_event()) got inactive 10000000:00010000:1.0:1787882687.427784:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030000/0xf4731e8a7c5deac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882687.427789:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787882687.427791:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787882687.427793:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787882687.427805:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280030000/0xf4731e8a7c5deac5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882687.427810:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882687.427816:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280030000/0xf4731e8a7c5deac5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882687.427823:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280030000/0xf4731e8a7c5deac5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5deacc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882687.427837:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882687.427839:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882687.427840:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787882687.427850:0:13080:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787882687.427856:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730564011648:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787882687.427859:0:13080:0:(import.c:65:import_set_state_nolock()) ffff9fa2b553f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787882687.427914:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fa2a99fb370) has no exports 00000100:00100000:1.0:1787882687.427943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882687.428003:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787882687.428016:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b727c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730564011904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787882687.428040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882687.428071:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564011648 00000100:00100000:1.0:1787882687.428079:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564011648 00000100:00100000:1.0:1787882687.428121:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564011904 00000100:00100000:1.0:1787882687.428124:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564011904 00000100:00100000:1.0:1787882687.428142:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787882687.428151:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+20:3305:x1874730564011648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787882687.428166:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882687.428181:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b7265a00/0xf4731e8a7c5df01a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5df013 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882687.428194:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882687.428231:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+19:3305:x1874730564011648:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882687.428238:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787882687.428254:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787882687.428260:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+18:3305:x1874730564011904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787882687.428268:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882687.428277:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa281523c00/0xf4731e8a7c5deacc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5deac5 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882687.428288:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882687.428307:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:3305:x1874730564011904:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882687.428313:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:1.0:1787882687.428330:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2b9a01000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787882687.428371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2bb1ca000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787882687.428404:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2af870800 for lustre-MDT0000 00000020:00000080:1.0:1787882687.428408:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2bb1c8000 for lustre-MDT0000 00010000:00010000:1.0:1787882687.428421:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882687.428434:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564011776:0@lo:9:umount.0 00000100:00100000:1.0:1787882687.428469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882687.428491:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564012032:0@lo:9:umount.0 00000100:00100000:1.0:1787882687.428513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882687.430290:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564011776 00000100:00100000:1.0:1787882687.430306:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564011776 00000100:00100000:1.0:1787882687.430386:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564012032 00000100:00100000:1.0:1787882687.430390:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564012032 00000100:00100000:1.0:1787882687.430430:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787882687.430442:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874730564011776:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787882687.430476:0:6709:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dec69 00000100:00080000:1.0:1787882687.430488:0:6709:0:(import.c:65:import_set_state_nolock()) ffff9fa2bb1ce000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787882687.430537:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787882687.431007:0:12080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787882687.431011:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1874730564011776:12345-0@lo:9:umount.0 Request processed in 571us (2541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882687.431018:0:12080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1874730564012032:12345-0@lo:9:umount.0 00000100:00100000:1.0:1787882687.431019:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000020:00000080:0.0:1787882687.431035:0:12080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5ded42 00010000:00010000:1.0:1787882687.431041:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787882687.431041:0:12080:0:(import.c:65:import_set_state_nolock()) ffff9fa2bff7a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787882687.431069:0:12080:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787882687.431081:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b727c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730564011904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787882687.431093:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b622ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3305:1874730564011648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787882687.431122:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787882687.431164:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2af875000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787882687.431179:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787882687.431182:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787882687.431186:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564011776:0@lo:9:umount.0 00000100:00100000:1.0:1787882687.431274:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787882687.431290:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730564011520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787882687.431292:0:12080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3304:x1874730564012032:12345-0@lo:9:umount.0 Request processed in 276us (2777us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882687.431297:0:12080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787882687.431331:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882687.431394:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564011520 00000100:00100000:1.0:1787882687.431399:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564011520 00000100:00100000:1.0:1787882687.431440:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787882687.431447:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+17:3307:x1874730564011520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787882687.431459:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882687.431482:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280030200/0xf4731e8a7c5dedf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5dedea expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882687.431501:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882687.431539:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3307:x1874730564011520:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882687.431545:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787882687.431585:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2b553f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787882687.431597:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787882687.431599:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787882687.431602:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564012032:0@lo:9:umount.0 10000000:01000000:2.0:1787882687.431664:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787882687.431668:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787882687.431714:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882687.431721:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787882687.431739:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882687.431746:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfe00/0xf4731e8a7c5ded11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5ded18 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882687.431777:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787882687.431786:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730564012160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787882687.431817:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882687.431843:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564012160 00000100:00100000:2.0:1787882687.431847:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564012160 00000100:00100000:2.0:1787882687.431893:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787882687.431900:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+16:3308:x1874730564012160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787882687.431909:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882687.431929:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280030800/0xf4731e8a7c5ded18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5ded11 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882687.431942:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882687.432142:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730564011520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787882687.432223:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8fe006bc-8a96-494d-a4af-8dd699ee0b84+15:3308:x1874730564012160:12345-0@lo:103:ldlm_bl.0 Request processed in 323us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882687.432231:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1787882687.432258:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882687.432261:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882687.432263:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882687.432504:0:8466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787882687.432644:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882687.436318:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730564012160:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787882687.459532:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fa2a99fb370) has no exports 00000020:00000080:2.0:1787882687.531199:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5deb20 00000020:00000080:2.0:1787882687.531215:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2b7191800/lustre-QMT0000_UUID 00000020:01000000:2.0:1787882687.531435:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787882687.531485:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2b7191800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787882687.531617:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787882687.531629:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787882687.531647:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9fa297fc8000) has no exports 00000020:00000080:0.0:1787882687.531986:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5deb19 00000020:00000080:0.0:1787882687.531993:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2b7185800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787882687.532051:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787882687.532058:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787882687.532061:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2b7181000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787882687.532065:0:13080:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2b7181000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787882687.532078:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787882687.532219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2b7185800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787882687.594082:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882688.620938:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787882689.382694:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e19aa4d4-406f-42d0-a5c3-03793bedba3c 00000001:00080000:0.0:1787882689.382717:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787882689.382725:0:5873:0:(genops.c:885:class_export_put()) final put ffff9fa2c159e000/e19aa4d4-406f-42d0-a5c3-03793bedba3c 00000020:00000080:0.0:1787882689.382764:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2c159e000/e19aa4d4-406f-42d0-a5c3-03793bedba3c for lustre-MDT0000 00000020:00000080:0.0:1787882689.382841:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2c159e800 for lustre-MDT0000 00000001:00100000:3.0:1787882689.386535:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787882689.386548:0:7664:0:(genops.c:885:class_export_put()) final put ffff9fa2bff79000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787882689.386641:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2bff79000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787882689.386944:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2bff7a800 for lustre-OST0001 00000020:01000000:0.0:1787882689.581232:0:13080:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa2b66d06c0 - data ffff9fa2bfc1a6c0/ffff9fa2b9847400 00000020:01000000:0.0:1787882689.581399:0:13080:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa2c17db000 - data ffff9fa2aa3686c0/ffff9fa2b7073c00 00000001:00000004:0.0:1787882689.591214:0:13080:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:2.0:1787882689.642608:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787882689.728818:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787882689.728826:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787882689.728931:0:13080:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787882689.728935:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787882689.730444:0:7111:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787882689.730450:0:7111:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787882689.730460:0:7111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787882689.732061:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787882689.732066:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787882689.732111:0:13080:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787882689.732115:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787882689.732307:0:8111:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787882689.732311:0:8111:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787882689.732320:0:8111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787882689.813902:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5deae8 00000020:00000080:1.0:1787882689.813916:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2af86d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787882689.815240:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5deafd 00000020:00000080:1.0:1787882689.815256:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2af876800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787882689.815262:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787882689.815267:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787882689.815276:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787882689.815280:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9fa2a99f99b8) has no exports 00000004:01000000:1.0:1787882689.815436:0:13080:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787882689.815444:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5ded3b 00000020:00000080:1.0:1787882689.815448:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2c159f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787882689.815451:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787882689.815455:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787882689.815462:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787882689.815464:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9fa2b7138000) has no exports 00000020:00000080:1.0:1787882689.815469:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5ded34 00000020:00000080:1.0:1787882689.815473:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2af599800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787882689.816095:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2af86d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787882689.816109:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2af876800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787882689.816114:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2c159f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787882689.816119:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2af599800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787882689.817702:0:13080:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787882689.817709:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787882689.817713:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1787882689.818027:0:13080:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787882689.818031:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787882689.818117:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787882689.818143:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787882689.818152:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dec54 00000020:00000080:1.0:1787882689.818162:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2bb1cf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787882689.818193:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2b553f800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787882689.818200:0:36:0:(genops.c:885:class_export_put()) final put ffff9fa29d87d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787882689.818203:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa29d87d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787882689.818219:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787882689.818651:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787882689.818658:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787882689.818665:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787882689.818669:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9fa2c1238000) has no exports 00000020:00000080:1.0:1787882689.818676:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dec4d 00000020:00000080:1.0:1787882689.818680:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2af877800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787882689.818703:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2bb1cf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787882689.818791:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2af877800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1787882689.819313:0:13080:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787882689.819317:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787882689.819320:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1787882689.819330:0:13080:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787882689.819332:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787882689.819528:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787882689.819568:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787882689.819598:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787882689.819601:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787882689.819605:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2af869000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787882689.819608:0:13080:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2af869000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787882689.819613:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787882689.819742:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5deb04 00000020:00000080:1.0:1787882689.819746:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2af871800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787882689.819768:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2af875000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787882689.819774:0:36:0:(genops.c:885:class_export_put()) final put ffff9fa29d878800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787882689.819776:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa29d878800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787882689.819780:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787882689.819954:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787882689.819958:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787882689.819963:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787882689.819966:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9fa2a99fcd28) has no exports 00000020:00000080:1.0:1787882689.819987:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787882689.819990:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787882689.819994:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5deb0b 00000020:00000080:1.0:1787882689.819997:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2af871000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787882689.820013:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2af871800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787882689.820016:0:36:0:(genops.c:885:class_export_put()) final put ffff9fa2af86d000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787882689.820018:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2af86d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787882689.820022:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1787882689.820242:0:13080:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa285a97800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787882689.820246:0:13080:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa285a97800 3 00000020:01000004:1.0:1787882689.820249:0:13080:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa285a97800 from lustre-MDT0000 00000020:00000080:1.0:1787882689.820268:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787882689.820272:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787882689.820274:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2af868000/lustre-MDT0000_UUID 00000020:00000080:1.0:1787882689.820277:0:13080:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2af868000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787882689.820283:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787882689.820306:0:13080:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1787882689.820309:0:13080:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787882689.820312:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787882689.820314:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787882689.820317:0:13080:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787882689.820323:0:13080:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9fa2a0265000 8fe006bc-8a96-494d-a4af-8dd699ee0b84 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787882689.820345:0:13080:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9fa297fc99b8) has exports, disconnecting them 00000020:00080000:1.0:1787882689.820350:0:13080:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fa2a0265000), last request at 1787882461 00000020:00000080:1.0:1787882689.820363:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5deaa9 00000020:00010000:1.0:1787882689.820367:0:13080:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fa2a0265000: total 1 00000100:00080000:1.0:1787882689.820371:0:13080:0:(import.c:65:import_set_state_nolock()) ffff9fa2a0266000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787882689.820390:0:13080:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa2a0265000): rc 0 00000020:00080000:1.0:1787882689.820395:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9fa297fc99b8) has no exports 00000100:00100000:1.0:1787882689.820449:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fa2a04e1200:5838] 2 exiting: rc = 0 00000020:00010000:0.0:1787882689.820542:0:11677:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fa2a0265000: total 1 00010000:00010000:0.0:1787882689.820586:0:11677:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fa2a0265000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787882689.820613:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b67d9600/0xf4731e8a7c5deffe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5deff7 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882689.820630:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dedff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5dedf8 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882689.820653:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b7264200/0xf4731e8a7c5df00c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5df005 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882689.820666:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa281523400/0xf4731e8a7c5debc1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5debba expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882689.820678:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b67cec00/0xf4731e8a7c5dedab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5deda4 expref: 5 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882689.820688:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b67cf200/0xf4731e8a7c5dedb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5dedb2 expref: 4 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882689.820698:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031800/0xf4731e8a7c5dedd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5dedce expref: 3 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882689.820707:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b67cf600/0xf4731e8a7c5dedc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4731e8a7c5dedc0 expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882689.820716:0:11677:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fa2a0265000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787882689.820726:0:11677:0:(genops.c:885:class_export_put()) final put ffff9fa2a0265000/8fe006bc-8a96-494d-a4af-8dd699ee0b84 00000100:00100000:1.0:1787882689.821002:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fa2a99f1400:5835] 0 exiting: rc = 1 00000020:00000080:2.0:1787882689.821068:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2af871000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787882689.821183:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882689.821186:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882689.821188:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787882689.821207:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2a0265000/8fe006bc-8a96-494d-a4af-8dd699ee0b84 for MGS 00000020:00000080:2.0:1787882689.821290:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2a0266000 for MGS 00000100:00100000:3.0:1787882689.822144:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fa2a991d400:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1787882689.822274:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822284:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822292:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822300:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822309:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822317:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822322:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822328:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822342:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822348:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822355:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822360:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822365:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822371:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822377:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822382:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822388:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822393:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822398:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822404:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822420:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822428:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822433:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822439:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822444:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822450:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822462:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822467:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822473:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822479:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822485:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822491:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822496:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822502:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822507:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822513:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822518:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822523:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822528:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822534:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822539:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822544:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822548:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822553:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822567:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822573:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822577:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822582:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822591:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822596:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822601:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822606:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822611:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822616:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822621:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822631:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822636:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822642:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822648:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822653:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822658:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822663:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822668:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.822672:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787882689.823070:0:13080:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787882689.823074:0:13080:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787882689.824055:0:13080:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa2b7176ae0 - data ffff9fa2bfc826c0/ffff9fa2b98fc400 00000020:01000000:1.0:1787882689.824177:0:13080:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa285bb8b40 - data ffff9fa2aa320510/ffff9fa28660bc00 00000020:00000080:1.0:1787882689.825030:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dea8d 00000020:00000080:1.0:1787882689.825040:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2900d9000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787882689.825095:0:13080:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa285a97800 from MGS, refs=2 00000020:01000004:1.0:1787882689.825100:0:13080:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa285a97800 2 00000020:01000004:1.0:1787882689.825103:0:13080:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa285a97800 from MGS 00000020:00000080:1.0:1787882689.825125:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787882689.825131:0:13080:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787882689.825133:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa287a93000/MGS 00000020:00000080:1.0:1787882689.825136:0:13080:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa287a93000/MGS for MGS 00000020:01000000:1.0:1787882689.825143:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787882689.825196:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787882689.825200:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787882689.825205:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787882689.825212:0:13080:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fa2a980f800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787882689.825218:0:13080:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9fa2c123cd28) has exports, disconnecting them 00000020:00080000:1.0:1787882689.825222:0:13080:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fa2a980f800), last request at 1787882462 00000020:00000080:1.0:1787882689.825226:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5deb58 00000020:00080000:1.0:1787882689.825235:0:13080:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa2a980f800): rc 0 00000020:00000080:1.0:1787882689.825239:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2a980f800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787882689.827498:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2900d9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787882689.829196:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2a980f800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787882689.849029:0:13080:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787882689.849038:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787882689.849042:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787882689.849049:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787882689.849473:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787882689.849481:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787882689.849487:0:13080:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa285a97800 1 00000020:00000080:0.0:1787882689.849494:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dea7f 00000020:00000080:0.0:1787882689.849501:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa287a97000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787882689.851886:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787882689.851911:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787882689.851920:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787882689.851925:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9fa2866e99b8) has no exports 00000020:00000080:2.0:1787882689.852976:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2a9808000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787882689.852989:0:36:0:(genops.c:885:class_export_put()) final put ffff9fa2b7186800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787882689.852992:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2b7186800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787882689.853003:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787882689.853062:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa287a97000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:2.0:1787882689.896889:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787882689.896899:0:6737:0:(genops.c:885:class_export_put()) final put ffff9fa2bb1cd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787882689.896929:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2bb1cd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787882689.896981:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2bb1ce000 for lustre-OST0000 00000020:00000080:1.0:1787882689.938751:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787882689.938764:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787882689.938770:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa28339a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787882689.938774:0:13080:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa28339a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787882689.938787:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787882689.938971:0:13080:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fa285a94000 00000020:01000000:1.0:1787882689.938995:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787882689.938999:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787882689.939004:0:13080:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787882689.939007:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9fa297fccd28) has no exports 00000100:00100000:1.0:1787882689.939104:0:6733:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9fa2bf420600:6733] 3 exiting: rc = 0 00000100:00100000:3.0:1787882689.940419:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9fa2a989f600:5843] 0 exiting: rc = 1 00000100:00100000:2.0:1787882689.940430:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9fa2a989e600:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1787882689.943696:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9fa2a989e000:5845] 2 exiting: rc = 0 00000100:00100000:0.0:1787882689.944808:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.944818:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.944825:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.944831:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.944838:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.944845:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.944852:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.944859:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.944866:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945145:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945157:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945164:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945170:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945185:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945193:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945202:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945209:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945215:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945222:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945227:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945232:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945238:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945244:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945249:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945254:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945260:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945266:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945271:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945278:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945285:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945293:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945444:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945453:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945458:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945464:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945469:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945475:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945481:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945486:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945490:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945495:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945500:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945505:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945511:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945518:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945529:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945536:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945547:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945556:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945630:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945638:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945645:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945652:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945661:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945668:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945675:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945682:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945690:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945699:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945707:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945714:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945720:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945727:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.945734:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955132:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fa2a989f800:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1787882689.955271:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fa2a989fa00:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1787882689.955614:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955623:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955629:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955637:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955644:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955649:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955654:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955660:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955664:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955670:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955675:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955681:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955687:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955693:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955698:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955703:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955771:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955777:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955785:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955792:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955800:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955820:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955829:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955839:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955846:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955856:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.955861:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956054:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956068:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956075:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956082:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956089:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956096:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956103:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956110:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956117:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956123:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956129:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956135:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956141:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956149:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956156:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956167:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956174:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956181:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956188:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956196:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956203:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956209:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956214:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956219:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956224:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956229:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956235:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956240:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956246:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956259:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956264:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956270:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956277:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956288:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956298:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956309:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.956496:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.957649:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9fa28c5e3800:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1787882689.958048:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9fa297e6ea00:5848] 0 exiting: rc = 1 00000100:00100000:1.0:1787882689.958198:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958208:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958215:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958221:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958236:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958243:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958250:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958256:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958263:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958269:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958275:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958281:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958288:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958294:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958300:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958306:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958484:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958492:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958498:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958504:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958510:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958516:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958521:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958527:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958533:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958539:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958545:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958572:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958591:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958598:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958604:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958610:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958616:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958621:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958627:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958633:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958638:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958644:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958649:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958655:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958678:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958686:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958693:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958699:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958753:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958763:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958769:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958775:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958781:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958786:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958791:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958797:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958818:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958826:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958834:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958841:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958850:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958857:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.958865:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.964087:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.964097:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.964103:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.964127:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882689.964133:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787882689.978379:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fa286008c00:5851] 1 exiting: rc = 0 00000100:00100000:1.0:1787882689.978472:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fa2860e2a00:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1787882689.978586:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978605:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978612:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978619:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978627:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978634:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978643:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978653:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978663:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978672:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978677:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978796:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978804:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978809:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978814:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978818:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978823:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978828:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978832:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978837:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978841:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978846:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978850:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978854:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978859:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978864:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978975:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978983:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978990:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.978996:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979003:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979009:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979015:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979021:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979028:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979035:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979047:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979053:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979059:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979066:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979072:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979079:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979086:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979094:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979101:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979108:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979116:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979122:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979129:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979136:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979142:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979149:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979159:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979168:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979177:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979186:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979194:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979198:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979209:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979214:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979219:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979223:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979228:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.979233:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787882689.980543:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fa2860e2400:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1787882689.980614:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fa286009a00:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1787882689.981835:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981842:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981847:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981851:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981856:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981861:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981866:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981911:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981917:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981922:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981928:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981932:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981937:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981941:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981946:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981952:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981957:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981962:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981968:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981973:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981978:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981982:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981988:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981992:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.981997:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982001:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982006:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982011:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982016:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982021:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982026:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982031:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982036:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982040:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982045:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982049:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982053:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982058:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982064:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982070:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982076:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982081:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982093:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982097:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982102:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982106:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982111:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982115:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982120:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982124:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982129:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982134:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982139:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982143:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982148:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982152:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982156:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982161:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982165:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982169:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982174:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982178:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982182:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.982186:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983494:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fa286008400:5855] 1 exiting: rc = 0 00000100:00100000:2.0:1787882689.983616:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fa286009200:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1787882689.983720:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983726:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983730:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983735:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983740:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983745:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983751:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983756:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983761:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983766:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983772:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983777:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983794:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983799:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983804:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983808:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983813:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983818:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983823:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983829:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983835:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983841:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983847:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983857:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983865:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983904:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983909:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983914:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983919:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983923:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983928:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983933:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983937:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983942:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983947:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983952:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983957:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983963:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983968:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983973:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983978:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983982:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983987:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983991:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.983996:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984001:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984006:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984019:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984024:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984028:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984033:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984038:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984043:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984049:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984054:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984059:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984064:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984068:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984072:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984076:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984081:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984085:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984090:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984094:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.984786:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9fa2b54b9c00:5859] 2 exiting: rc = 0 00000100:00100000:1.0:1787882689.984866:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9fa2b54b9600:5858] 1 exiting: rc = 0 00000100:00100000:2.0:1787882689.985064:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9fa28c5e3a00:5857] 0 exiting: rc = 1 00000100:00100000:0.0:1787882689.986445:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986453:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986460:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986465:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986470:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986475:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986481:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986486:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986491:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986497:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986502:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986507:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986512:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986517:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986522:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986527:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986533:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986554:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986587:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986594:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986600:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986605:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986611:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986617:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986627:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986633:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986640:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986646:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986652:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986657:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986662:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986668:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986673:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986678:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986684:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986690:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986696:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986702:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986707:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986712:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986718:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986727:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986748:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986756:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986761:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986766:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986772:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986778:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986784:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986789:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986795:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986800:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986812:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986817:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986822:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986827:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986832:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986837:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986842:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986847:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986852:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986857:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986862:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787882689.986891:0:13080:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787882689.996466:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787882689.996478:0:13080:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787882689.996483:0:13080:0:(genops.c:885:class_export_put()) final put ffff9fa2a052b800/MDS_uuid 00000020:00000080:0.0:1787882689.996488:0:13080:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2a052b800/MDS_uuid for MDS 00000020:01000000:0.0:1787882689.996493:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787882689.997033:0:13080:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787882690.667140:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882691.690152:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882691.883029:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787882691.890252:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564012416:0@lo:400:kworker.0 00000100:00100000:1.0:1787882691.892446:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730564012288:0@lo:400:kworker.0 00000400:00000100:1.0:1787882691.892506:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874730564012288 offset 0 length 224: 4 00000100:00100000:1.0:1787882691.892585:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730564012544:0@lo:400:kworker.0 00000400:00000100:1.0:1787882691.892605:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874730564012544 offset 0 length 224: 4 00000400:00000100:1.0:1787882691.894609:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874730564012416 offset 0 length 224: 4 00010000:00010000:2.0:1787882692.714032:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787882692.790998:0:13232:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787882692.814138:0:13232:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787882692.814195:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882692.814494:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882692.814502:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882692.814510:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882692.814535:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787882692.814572:0:13232:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1787882692.814583:0:11677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882692.814594:0:11677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882692.814603:0:11677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2c21c6000 already unused, calling callback (ffffffffc1bb9c20) 00000100:00080000:0.0:1787882692.814605:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:2.0:1787882692.814607:0:11677:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882692.814619:0:11677:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882692.814621:0:13232:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa181d72680 x1874730564012416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882707 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:2.0:1787882692.814637:0:11677:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882692.814643:0:11677:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787882692.814645:0:11677:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787882692.814647:0:11677:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787882692.814692:0:11677:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882692.814699:0:11677:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787882692.814713:0:13232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787882692.814721:0:13232:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1787882692.814737:0:11677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787882692.814740:0:13232:0:(import.c:65:import_set_state_nolock()) ffff9fa2bb1cb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787882692.814759:0:11677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6000/0xf4731e8a7c5dedc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4731e8a7c5dedc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882692.814773:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882692.814775:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882692.814777:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882692.815664:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787882692.815693:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730564012672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787882692.815792:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882692.815946:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564012672 00000100:00100000:0.0:1787882692.815958:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564012672 00000100:00100000:0.0:1787882692.816323:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787882692.816504:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1874730564012672:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787882692.816513:0:5828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787882692 with bad export cookie 17614456147716991657 00000100:00100000:0.0:1787882692.837894:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1874730564012672:12345-0@lo:103:ldlm_bl.0 Request processed in 21521us (22074us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787882692.837913:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787882692.838058:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787882692.838064:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fa2a052a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787882692.838069:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1787882692.839234:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564012416:0@lo:400:kworker.0 00000100:00100000:1.0:1787882692.840864:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874730564012800:0@lo:39:umount.0 00000400:00000100:1.0:1787882692.842741:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874730564012800 offset 0 length 224: 4 00000100:00080000:0.0:1787882692.853450:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.121@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787882692.853457:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787882692.853470:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa181d70000 x1874730564012288/t0(0) o400->MGC192.168.206.121@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787882707 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882692.853558:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa181d72a00 x1874730564012672/t0(0) o103->MGC192.168.206.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787882708 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787882692.853570:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787882692.853573:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787882692.853575:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787882692.853580:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9fa2a052a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787882692.853611:0:3308:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 177 00000100:00080000:0.0:1787882692.853621:0:3308:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import ffff9fa2a052a000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1787882692.853657:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2b9877800 x1874730564012928/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787882692.853701:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3308:1874730564012672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787882692.853777:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3304:1874730564012928:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1787882692.853844:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874730564012928 offset 0 length 520: 4 00000100:00100000:2.0:1787882692.854471:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3307:1874730564012288:0@lo:400:kworker.0 00010000:00010000:2.0:1787882693.738672:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882694.764813:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882695.786266:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882696.810752:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787882697.002597:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8fe006bc-8a96-494d-a4af-8dd699ee0b84->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787882697.002610:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8fe006bc-8a96-494d-a4af-8dd699ee0b84->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787882697.002760:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730564013056:0@lo:400:kworker.0 00000400:00000100:2.0:1787882697.002821:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874730564013056 offset 0 length 224: 4 00010000:00010000:2.0:1787882697.835430:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882698.858240:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882699.883042:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882700.906465:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882701.939833:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787882702.122049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8fe006bc-8a96-494d-a4af-8dd699ee0b84->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787882702.122063:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8fe006bc-8a96-494d-a4af-8dd699ee0b84->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787882702.122283:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730564013184:0@lo:400:kworker.0 00000400:00000100:2.0:1787882702.122358:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874730564013184 offset 0 length 224: 4 00000100:00100000:2.0:1787882702.123896:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787882692/real 1787882692] req@ffff9fa2b9877800 x1874730564012928/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787882702 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882702.123954:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa2b9877800 x1874730564012928/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787882702 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882702.123967:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787882692/real 1787882692] req@ffff9fa2b9874380 x1874730564012800/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787882702 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882702.123978:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa2b9874380 x1874730564012800/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787882702 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787882702.123994:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2a052a000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787882702.124060:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787882702.124065:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3304:1874730564012928:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1787882702.124072:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2bb1cb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787882702.124089:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874730564012800:0@lo:39:umount.0 00000100:00080000:3.0:1787882702.125597:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787882702.125609:0:13232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787882702.125618:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787882702.126978:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882702.127022:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882702.127030:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882702.127037:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882702.128399:0:11678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882702.128415:0:11678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882702.128427:0:11678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2c21c7e00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882702.128432:0:11678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882702.128442:0:11678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882702.128471:0:11678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882702.128478:0:11678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787882702.128481:0:11678:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1787882702.128505:0:11678:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2a052a000 00010000:00010000:1.0:1787882702.128509:0:11678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882702.128523:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882702.128525:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882702.128527:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882702.128671:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787882702.128680:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7e00/0xf4731e8a7c5dedce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5dedd5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882702.128701:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882702.128710:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882702.128717:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882702.128724:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882702.128792:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787882702.128797:0:13232:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1787882702.128803:0:13232:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787882702.128837:0:13232:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787882702.128847:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787882702.128853:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787882702.128860:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787882702.128865:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fa2a99f8000) has no exports 00000020:00080000:3.0:1787882702.128924:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fa2a99f8000) has no exports 00000100:00080000:0.0:1787882702.133204:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8fe006bc-8a96-494d-a4af-8dd699ee0b84->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787882702.133217:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787882702.133223:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fa2a052a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787882702.133233:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 409 00000100:00080000:0.0:1787882702.133241:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.121@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787882702.133249:0:36:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import ffff9fa2a052a000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1787882702.133307:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2b9876680 x1874730564013312/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787882702.133400:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3304:1874730564013312:0@lo:250:kworker.0 00000400:00000100:0.0:1787882702.133463:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874730564013312 offset 0 length 520: 4 00010000:00010000:2.0:1787882702.136453:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882702.136472:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882702.136487:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67ce600 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1787882702.136503:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882702.136516:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882702.136525:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882702.136562:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787882702.136566:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787882702.136569:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787882702.136662:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2a052a000 00010000:00010000:2.0:1787882702.136667:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882702.136673:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b67ce600/0xf4731e8a7c5df005 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5df00c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882702.136692:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882702.136694:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882702.136696:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787882702.137538:0:13232:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa2a986c180 - data ffff9fa2bfc12bd0/ffff9fa2af7e1800 00000020:01000000:3.0:1787882702.138530:0:13232:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa2a9822960 - data ffff9fa2bfc29a20/ffff9fa2bf24fc00 00100000:10000000:2.0:1787882702.159371:0:13232:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787882702.210101:0:13232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5debdd 00000020:00000080:1.0:1787882702.210114:0:13232:0:(genops.c:885:class_export_put()) final put ffff9fa2bf4ac000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787882702.210139:0:13232:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa29d82f000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787882702.210143:0:13232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa29d82f000 2 00000020:01000004:1.0:1787882702.210146:0:13232:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa29d82f000 from lustre-OST0000 00000020:00000080:1.0:1787882702.210178:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787882702.210190:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787882702.210194:0:13232:0:(genops.c:885:class_export_put()) final put ffff9fa2af873000/lustre-OST0000_UUID 00000020:00000080:1.0:1787882702.210197:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2af873000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787882702.210204:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787882702.210251:0:13232:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787882702.210255:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787882702.210259:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787882702.210275:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787882702.210283:0:13232:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fa2bb1cc000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787882702.210290:0:13232:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9fa2b713cd28) has exports, disconnecting them 00000020:00080000:1.0:1787882702.210295:0:13232:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fa2bb1cc000), last request at 1787882479 00000020:00000080:1.0:1787882702.210315:0:13232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dec07 00000020:00080000:1.0:1787882702.210325:0:13232:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa2bb1cc000): rc 0 00000020:00000080:1.0:1787882702.210332:0:13232:0:(genops.c:885:class_export_put()) final put ffff9fa2bb1cc000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787882702.211124:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2bf4ac000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787882702.211146:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2bb1cc000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787882702.212213:0:13232:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787882702.212221:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787882702.212226:0:13232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787882702.212235:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787882702.212349:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2bb1cb800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787882702.212452:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787882702.212474:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787882702.212480:0:13232:0:(genops.c:885:class_export_put()) final put ffff9fa2bb1cc800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787882702.212484:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2bb1cc800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787882702.212506:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787882702.212789:0:13232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa29d82f000 1 00000020:00000080:2.0:1787882702.212798:0:13232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5deb97 00000020:00000080:2.0:1787882702.212806:0:13232:0:(genops.c:885:class_export_put()) final put ffff9fa2b553e000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787882702.212822:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787882702.212828:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787882702.212833:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:3.0:1787882702.212851:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2b553e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:2.0:1787882702.212853:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9fa2866eb370) has no exports 00000020:00000080:2.0:1787882702.238503:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787882702.238523:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787882702.238530:0:13232:0:(genops.c:885:class_export_put()) final put ffff9fa2a04b8800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787882702.238536:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2a04b8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787882702.238547:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787882702.238735:0:13232:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fa29d828800 00000020:02000400:2.0:1787882702.238792:0:13232:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787882702.954386:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882703.982861:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787882704.997547:0:13385:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00010000:00010000:1.0:1787882705.012210:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787882705.014609:0:13385:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787882705.014712:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882705.014729:0:13385:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882705.014738:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882705.014746:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882705.014819:0:13385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787882705.014826:0:13385:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787882705.014852:0:13385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1787882705.014939:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882705.014948:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882705.014958:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264000 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1787882705.014961:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882705.014971:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882705.014980:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882705.014986:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787882705.014988:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787882705.014991:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1787882705.015096:0:13385:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa181d71c00 x1874730564012544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882707 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882705.015148:0:13385:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa2b9875c00 x1874730564013056/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882713 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882705.015400:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874730564012544:0@lo:400:kworker.0 00010000:00010000:2.0:1787882705.015425:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2a052a000 00010000:00010000:2.0:1787882705.015432:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882705.015440:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b7264000/0xf4731e8a7c5deda4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5dedab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882705.015462:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882705.015464:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882705.015467:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882705.015645:0:13385:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa2b9875500 x1874730564013184/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882718 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882705.015666:0:13385:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787882705.015675:0:13385:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787882705.015719:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730564013184:0@lo:400:kworker.0 00000100:00080000:3.0:1787882705.015837:0:13385:0:(import.c:65:import_set_state_nolock()) ffff9fa2b9a03000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787882705.016725:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730564013056:0@lo:400:kworker.0 00000100:00100000:0.0:1787882705.016919:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874730564013440:0@lo:39:umount.0 00000400:00000100:0.0:1787882705.016988:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874730564013440 offset 0 length 224: 4 00010000:00010000:2.0:1787882706.027450:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882707.050107:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787882707.242014:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8fe006bc-8a96-494d-a4af-8dd699ee0b84->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787882707.242051:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8fe006bc-8a96-494d-a4af-8dd699ee0b84->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787882708.074169:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882709.098052:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882710.122273:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882711.146904:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882712.170820:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787882712.362339:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8fe006bc-8a96-494d-a4af-8dd699ee0b84->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787882712.362348:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8fe006bc-8a96-494d-a4af-8dd699ee0b84->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787882713.196937:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882714.219144:0:11677:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882715.242112:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787882705/real 1787882705] req@ffff9fa2af5db480 x1874730564013440/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787882715 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882715.242165:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa2af5db480 x1874730564013440/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787882715 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787882715.242190:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2b9a03000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787882715.242212:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874730564013440:0@lo:39:umount.0 00000100:00080000:1.0:1787882715.243499:0:13385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787882715.243567:0:13385:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787882715.243576:0:13385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787882715.253338:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882715.253376:0:13385:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882715.253384:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882715.253390:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882715.253432:0:13385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787882715.253440:0:13385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882715.253468:0:13385:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882715.253474:0:13385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882715.253480:0:13385:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882715.253682:0:13385:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787882715.253689:0:13385:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787882715.253720:0:13385:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787882715.253725:0:13385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787882715.253732:0:13385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787882715.253739:0:13385:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787882715.253745:0:13385:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9fa29d9f0000) has no exports 00000020:00080000:1.0:1787882715.255008:0:13385:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9fa29d9f0000) has no exports 00010000:00010000:2.0:1787882715.256646:0:11678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787882715.256664:0:11678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882715.256679:0:11678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2c21c6a00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1787882715.256684:0:11678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882715.256697:0:11678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882715.256705:0:11678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882715.256712:0:11678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787882715.256715:0:11678:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787882715.256718:0:11678:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787882715.256741:0:11678:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2a052a000 00010000:00010000:2.0:1787882715.256745:0:11678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882715.256776:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c6a00/0xf4731e8a7c5dedb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5dedb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882715.256803:0:11678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882715.256808:0:11678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882715.256814:0:11678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1787882715.256817:0:11678:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882715.256824:0:11678:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882715.256830:0:11678:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882715.256835:0:11678:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787882715.256838:0:11678:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787882715.256840:0:11678:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787882715.256845:0:11678:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2a052a000 00010000:00010000:2.0:1787882715.256849:0:11678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882715.256856:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b7265800/0xf4731e8a7c5deff7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5deffe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882715.257783:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882715.257788:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882715.257802:0:11678:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882715.260576:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882715.268201:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787882715.268370:0:13385:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa289289360 - data ffff9fa2bfc125e8/ffff9fa2bf2b7400 00000020:01000000:0.0:1787882715.268557:0:13385:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fa2b7076480 - data ffff9fa2bfc44000/ffff9fa2b6448c00 00100000:10000000:0.0:1787882715.280652:0:13385:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787882715.314575:0:13385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5deca8 00000020:00000080:0.0:1787882715.314589:0:13385:0:(genops.c:885:class_export_put()) final put ffff9fa2bff7a000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787882715.314613:0:13385:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa2c174b000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787882715.314618:0:13385:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa2c174b000 2 00000020:01000004:0.0:1787882715.314622:0:13385:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fa2c174b000 from lustre-OST0001 00000020:00000080:0.0:1787882715.314654:0:13385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787882715.314668:0:13385:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787882715.314671:0:13385:0:(genops.c:885:class_export_put()) final put ffff9fa284efb800/lustre-OST0001_UUID 00000020:00000080:0.0:1787882715.314675:0:13385:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa284efb800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787882715.314684:0:13385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787882715.314817:0:13385:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8fe006bc-8a96-494d-a4af-8dd699ee0b84->MGS 00010000:00010000:0.0:1787882715.314839:0:13385:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7a00/0xf4731e8a7c5debba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5debc1 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787882715.314853:0:13385:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7a00/0xf4731e8a7c5debba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5debc1 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882715.314906:0:13385:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787882715.314909:0:13385:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787882715.314913:0:13385:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787882715.314932:0:13385:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2a052a000 00010000:00010000:0.0:1787882715.314937:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2c21c7a00/0xf4731e8a7c5debba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5debc1 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882715.314955:0:13385:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfc00/0xf4731e8a7c5dedf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4731e8a7c5dedff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787882715.314963:0:13385:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfc00/0xf4731e8a7c5dedf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4731e8a7c5dedff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882715.314969:0:13385:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787882715.314972:0:13385:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787882715.314974:0:13385:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787882715.314983:0:13385:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fa2a052a000 00010000:00010000:0.0:1787882715.314986:0:13385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b67cfc00/0xf4731e8a7c5dedf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4731e8a7c5dedff expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787882715.315005:0:13385:0:(import.c:65:import_set_state_nolock()) ffff9fa2a052a000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787882715.315010:0:13385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787882715.315013:0:13385:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787882715.315014:0:13385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787882715.315019:0:13385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787882715.315032:0:13385:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fa2b9876680 x1874730564013312/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787882717 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787882715.315058:0:13385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787882715.315061:0:13385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1787882715.315268:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8fe006bc-8a96-494d-a4af-8dd699ee0b84:3304:1874730564013312:0@lo:250:kworker.0 00000020:00000080:2.0:1787882715.315413:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2bff7a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1787882715.315564:0:13385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787882715.315581:0:13385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dea9b 00000020:00000080:0.0:1787882715.315586:0:13385:0:(genops.c:885:class_export_put()) final put ffff9fa2a052c000/8fe006bc-8a96-494d-a4af-8dd699ee0b84 00000020:01000000:0.0:1787882715.315603:0:13385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.121@tcp (flags='') 00000020:00000080:0.0:1787882715.315609:0:13385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787882715.315615:0:13385:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.121@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787882715.315621:0:13385:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9fa297fcb370) has no exports 00000020:00000080:2.0:1787882715.315686:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2a052c000/8fe006bc-8a96-494d-a4af-8dd699ee0b84 for MGC192.168.206.121@tcp 10000000:01000000:1.0:1787882715.316000:0:5841:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787882715.316102:0:13385:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.121@tcp: client import never connected 00000100:00080000:0.0:1787882715.316105:0:13385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787882715.316108:0:13385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787882715.316110:0:13385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787882715.316112:0:13385:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787882715.316165:0:13385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787882715.316171:0:13385:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.121@tcp (uuid 8fe006bc-8a96-494d-a4af-8dd699ee0b84) 00000020:01000000:0.0:1787882715.316177:0:13385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787882715.316180:0:13385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787882715.316184:0:13385:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787882715.316190:0:13385:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fa2b9a02800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:2.0:1787882715.316323:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2a052a000 for MGC192.168.206.121@tcp 00000020:00000080:2.0:1787882715.316331:0:37:0:(genops.c:885:class_export_put()) final put ffff9fa2a052e800/8fe006bc-8a96-494d-a4af-8dd699ee0b84 00000020:00000080:2.0:1787882715.316334:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2a052e800/8fe006bc-8a96-494d-a4af-8dd699ee0b84 for MGC192.168.206.121@tcp 00000020:01000000:2.0:1787882715.316339:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.121@tcp (8fe006bc-8a96-494d-a4af-8dd699ee0b84) 00000020:00080000:0.0:1787882715.316735:0:13385:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9fa2c12399b8) has exports, disconnecting them 00000020:00080000:0.0:1787882715.316741:0:13385:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fa2b9a02800), last request at 1787882498 00000020:00000080:0.0:1787882715.316745:0:13385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5decd2 00000020:00080000:0.0:1787882715.316759:0:13385:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fa2b9a02800): rc 0 00000020:00000080:0.0:1787882715.316763:0:13385:0:(genops.c:885:class_export_put()) final put ffff9fa2b9a02800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787882715.317739:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2b9a02800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787882715.318954:0:13385:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787882715.318961:0:13385:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787882715.318966:0:13385:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787882715.318973:0:13385:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787882715.319048:0:11677:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787882715.319220:0:11678:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:2.0:1787882715.319323:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fa2b9a03000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1787882715.319918:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1787882715.320075:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1787882715.320450:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fa282b7f200:5827] 1 exiting: rc = 0 00000100:00100000:2.0:1787882715.320523:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fa28601ee00:5826] 0 exiting: rc = 1 00000100:00100000:1.0:1787882715.320612:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787882715.321149:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fa282b7fe00:5829] 1 exiting: rc = 0 00000100:00100000:2.0:1787882715.321232:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fa282b7e600:5830] 2 exiting: rc = 0 00000100:00100000:2.0:1787882715.321956:0:8466:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fa2bf444600:8466] 3 exiting: rc = 0 00000100:00100000:2.0:1787882715.323999:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fa282b7e400:5828] 0 exiting: rc = 1 00000100:00100000:1.0:1787882715.324240:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324249:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324257:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324280:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324287:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324293:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324299:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324306:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324313:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324320:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324326:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324333:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324339:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324346:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324353:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324359:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324367:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324373:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324380:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324386:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324393:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324399:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324404:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324410:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324416:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324436:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324443:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324449:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324454:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324459:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324465:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324470:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324475:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324481:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324486:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324491:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324497:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324502:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324515:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324521:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324527:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324533:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324538:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324544:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324549:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324553:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324558:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324564:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324569:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324574:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324580:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324587:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324593:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324599:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324605:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324612:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324618:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324624:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324630:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324636:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324643:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324649:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324655:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.324660:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787882715.326042:0:13385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787882715.326056:0:13385:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787882715.326064:0:13385:0:(genops.c:885:class_export_put()) final put ffff9fa2b9a05800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787882715.326069:0:13385:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2b9a05800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787882715.326076:0:13385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787882715.326305:0:13385:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa2c174b000 1 00000020:00000080:1.0:1787882715.326312:0:13385:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf4731e8a7c5dec77 00000020:00000080:1.0:1787882715.326320:0:13385:0:(genops.c:885:class_export_put()) final put ffff9fa2c174c000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787882715.326339:0:13385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787882715.326344:0:13385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787882715.326350:0:13385:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787882715.326355:0:13385:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9fa2866ecd28) has no exports 00000020:00000080:2.0:1787882715.327049:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2c174c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787882715.347049:0:13385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787882715.347071:0:13385:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787882715.347078:0:13385:0:(genops.c:885:class_export_put()) final put ffff9fa2c174e800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787882715.347084:0:13385:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2c174e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787882715.347488:0:13385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787882715.347790:0:13385:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fa2c1749800 00000020:01000000:1.0:1787882715.347823:0:13385:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787882715.347829:0:13385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787882715.347835:0:13385:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787882715.347839:0:13385:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9fa2b713b370) has no exports 00000020:00000080:1.0:1787882715.347893:0:13385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787882715.347902:0:13385:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787882715.347905:0:13385:0:(genops.c:885:class_export_put()) final put ffff9fa2b553a000/OSS_uuid 00000020:00000080:1.0:1787882715.347908:0:13385:0:(genops.c:844:class_export_destroy()) destroying export ffff9fa2b553a000/OSS_uuid for OSS 00000020:01000000:1.0:1787882715.347912:0:13385:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1787882715.347946:0:5839:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787882715.349565:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9fa286c79000:6709] 0 exiting: rc = 1 00000100:00100000:0.0:1787882715.350651:0:12080:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9fa28b977400:12080] 4 exiting: rc = 0 00000100:00100000:1.0:1787882715.353012:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9fa289068e00:6710] 1 exiting: rc = 0 00000100:00100000:1.0:1787882715.353132:0:9930:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9fa2c1568200:9930] 3 exiting: rc = 0 00000100:00100000:2.0:1787882715.358542:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9fa286661600:6711] 2 exiting: rc = 0 00000100:00100000:1.0:1787882715.359083:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359112:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359124:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359131:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359146:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359153:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359158:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359163:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359169:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359175:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359205:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359219:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359226:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359232:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359238:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359244:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359250:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359257:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359687:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359699:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359705:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359710:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359714:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359720:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359725:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359731:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359737:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359744:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359750:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359755:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359760:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359766:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359772:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359778:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359784:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359789:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359795:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359800:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359806:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359812:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359818:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359824:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359830:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359836:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359841:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359859:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359865:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359915:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359921:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359926:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359931:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359937:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359942:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359948:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359954:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359959:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359965:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359970:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359976:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359983:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359988:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.359994:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.360000:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.360007:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787882715.365000:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fa2c1124e00:6712] 0 exiting: rc = 1 00000100:00100000:3.0:1787882715.365474:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fa2c1124200:6713] 1 exiting: rc = 0 00000100:00100000:1.0:1787882715.365757:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365767:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365774:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365780:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365786:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365792:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365798:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365803:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365809:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365815:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365821:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365827:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365832:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365838:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365844:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365850:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365893:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365899:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365905:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365910:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365916:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365920:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365926:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365931:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365936:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365942:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365947:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365953:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365959:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365966:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365972:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365978:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365984:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365990:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.365996:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366002:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366007:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366012:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366017:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366023:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366029:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366035:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366041:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366046:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366052:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366062:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366069:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366077:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366083:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366089:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366116:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366131:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366147:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366156:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366162:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366168:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366174:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366180:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366186:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366192:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366208:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366214:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366220:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.366226:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787882715.368143:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fa29073ec00:6715] 1 exiting: rc = 0 00000100:00100000:2.0:1787882715.368589:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fa298079e00:6714] 0 exiting: rc = 1 00000100:00100000:1.0:1787882715.368935:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fa29073f400:6716] 2 exiting: rc = 0 00000100:00100000:1.0:1787882715.369018:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369026:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369031:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369038:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369043:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369050:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369072:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369079:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369085:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369102:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369109:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369115:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369120:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369126:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369140:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369147:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369154:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369159:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369166:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369171:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369177:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369386:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369394:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369400:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369406:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369412:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369418:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369433:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369439:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369446:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369465:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369472:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369478:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369483:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369489:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369494:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369500:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369506:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369512:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369518:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369525:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369531:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369537:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369542:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369548:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369554:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369560:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369565:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369571:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369577:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369583:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369589:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369595:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369601:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369608:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369614:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369627:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369645:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369652:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369658:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369663:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369669:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369676:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.369682:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.376687:0:6718:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fa29073e000:6718] 1 exiting: rc = 0 00000100:00100000:2.0:1787882715.377155:0:6717:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fa29073fe00:6717] 0 exiting: rc = 1 00000100:00100000:1.0:1787882715.377473:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377484:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377490:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377496:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377501:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377506:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377512:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377518:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377524:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377530:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377535:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377541:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377547:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377553:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377559:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377564:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377570:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377576:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377582:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377587:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377594:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377600:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377606:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377611:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377616:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377621:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377640:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377645:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377650:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377655:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377660:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377666:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377671:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377678:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377683:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377688:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377694:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377699:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377704:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377708:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377713:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377718:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377723:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377727:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377732:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377737:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377743:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377748:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377753:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377758:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377763:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377768:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377773:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377777:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377782:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377787:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377792:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377797:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377802:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377807:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377812:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377825:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377830:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.377836:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787882715.379004:0:6719:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fa286c78c00:6719] 0 exiting: rc = 1 00000100:00100000:3.0:1787882715.379648:0:6720:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fa298ad5000:6720] 1 exiting: rc = 0 00000100:00100000:1.0:1787882715.379852:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379861:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379891:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379900:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379907:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379914:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379921:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379928:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379934:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379941:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379948:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379966:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379974:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379981:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379987:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.379994:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380001:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380008:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380014:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380020:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380026:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380033:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380039:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380062:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380069:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380075:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380081:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380087:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380104:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380110:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380115:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380122:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380147:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380152:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380159:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380179:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380186:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380193:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380410:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380417:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380437:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380450:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380460:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380467:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380474:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380481:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380488:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380513:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380520:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380527:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380533:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380541:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380547:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380554:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380562:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380568:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380576:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380583:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380589:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380610:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380618:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380624:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380633:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787882715.380639:0:13385:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787882715.397570:0:13385:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787882732.576092:0:14001:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787882741.841624:0:14464:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787882741.841631:0:14464:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787882741.841758:0:14464:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa2bfbc0000 00000020:01000004:2.0:1787882741.841790:0:14464:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787882741.841799:0:14464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787882741.841816:0:14464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fa2c123cd28) 00000020:00000080:2.0:1787882741.841832:0:14464:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787882741.862997:0:14464:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787882741.871947:0:14464:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787882741.872746:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1787882741.873104:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1787882741.873303:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1787882741.873507:0:14464:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787882741.873579:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1787882741.874066:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1787882741.874236:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1787882741.874534:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1787882741.876961:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 102: rc = 0 00100000:10000000:3.0:1787882741.877259:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 102: rc = 0 00100000:10000000:3.0:1787882741.878569:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 299: rc = 0 00100000:10000000:3.0:1787882741.879437:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 299: rc = 0 00100000:10000000:3.0:1787882741.879841:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 299: rc = 0 00100000:10000000:3.0:1787882741.881855:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 299: rc = 0 00100000:10000000:3.0:1787882741.882503:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 299: rc = 0 00100000:10000000:3.0:1787882741.883209:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 299: rc = 0 00100000:10000000:3.0:1787882741.883586:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 299: rc = 0 00100000:10000000:3.0:1787882741.883901:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 299: rc = 0 00100000:10000000:3.0:1787882741.884328:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 299: rc = 0 00100000:10000000:3.0:1787882741.884864:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 299: rc = 0 00100000:10000000:3.0:1787882741.885461:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 299: rc = 0 00100000:10000000:3.0:1787882741.885729:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 299: rc = 0 00100000:10000000:3.0:1787882741.886343:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 656: rc = 0 00100000:10000000:3.0:1787882741.886687:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 656: rc = 0 00100000:10000000:3.0:1787882741.887216:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 656: rc = 0 00100000:10000000:3.0:1787882741.887557:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 656: rc = 0 00100000:10000000:3.0:1787882741.888229:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 656: rc = 0 00100000:10000000:3.0:1787882741.888592:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 656: rc = 0 00100000:10000000:3.0:1787882741.889033:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 656: rc = 0 00100000:10000000:3.0:1787882741.889802:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 656: rc = 0 00100000:10000000:3.0:1787882741.890207:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 656: rc = 0 00100000:10000000:3.0:1787882741.890662:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 656: rc = 0 00100000:10000000:3.0:1787882741.892847:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 656: rc = 0 00100000:10000000:3.0:1787882741.893265:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 656: rc = 0 00100000:10000000:3.0:1787882741.893812:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 656: rc = 0 00100000:10000000:3.0:1787882741.894248:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 656: rc = 0 00100000:10000000:3.0:1787882741.894621:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 656: rc = 0 00100000:10000000:3.0:1787882741.895258:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 656: rc = 0 00100000:10000000:3.0:1787882741.895636:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 656: rc = 0 00100000:10000000:3.0:1787882741.897007:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 656: rc = 0 00100000:10000000:2.0:1787882741.898117:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 656: rc = 0 00100000:10000000:2.0:1787882741.898694:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 656: rc = 0 00100000:10000000:2.0:1787882741.899049:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 656: rc = 0 00100000:10000000:2.0:1787882741.899519:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 656: rc = 0 00100000:10000000:2.0:1787882741.899974:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 656: rc = 0 00100000:10000000:2.0:1787882741.900820:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 656: rc = 0 00100000:10000000:2.0:1787882741.903246:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 656: rc = 0 00100000:10000000:2.0:1787882741.907421:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 656: rc = 0 00100000:10000000:2.0:1787882741.907746:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 656: rc = 0 00100000:10000000:2.0:1787882741.908043:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 656: rc = 0 00100000:10000000:2.0:1787882741.908320:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 656: rc = 0 00100000:10000000:2.0:1787882741.908598:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 656: rc = 0 00100000:10000000:2.0:1787882741.908864:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 656: rc = 0 00100000:10000000:2.0:1787882741.909166:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 656: rc = 0 00100000:10000000:2.0:1787882741.909577:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 108: rc = 0 00100000:10000000:2.0:1787882741.912683:0:14464:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787882741.913237:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 103: rc = 0 00100000:10000000:2.0:1787882741.913482:0:14464:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787882741.913549:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 103: rc = 0 00100000:10000000:2.0:1787882741.913740:0:14464:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787882741.914200:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 103: rc = 0 00100000:10000000:2.0:1787882741.914618:0:14464:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787882741.914692:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:2.0:1787882741.914918:0:14464:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787882741.915002:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:2.0:1787882741.915192:0:14464:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787882741.915265:0:14464:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00000020:00000080:2.0:1787882741.915949:0:14464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787882741.915959:0:14464:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787882741.915971:0:14464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5dfd9c 00000020:01000004:2.0:1787882741.915981:0:14464:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787882741.916102:0:14464:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787882741.916108:0:14464:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa2bfbc0000 from MGS 00000020:01000004:2.0:1787882741.916113:0:14464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787882741.916177:0:14464:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fa2c1238000) 00000020:00000080:2.0:1787882741.916191:0:14464:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787882741.916266:0:14464:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa2bfbc0000 from MGS, refs=2 00080000:01000000:2.0:1787882741.916271:0:14464:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787882741.916277:0:14464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5dfdaa 00000100:00100000:2.0:1787882741.916414:0:14464:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787882741.916563:0:14464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787882741.916570:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787882741.920384:0:14464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787882741.920404:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787882741.921903:0:14464:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882741.922177:0:14464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787882741.922185:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787882741.926556:0:14464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787882741.926579:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787882741.927174:0:14464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787882741.927181:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787882741.928079:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882741.928084:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882741.928086:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882741.928351:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882741.928354:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882741.928356:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882741.928922:0:14464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787882741.934993:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787882741.947572:0:14464:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787882741.947599:0:14464:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787882741.947602:0:14464:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787882741.956426:0:14473:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787882741.965481:0:14464:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787882741.968038:0:14464:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787882741.970208:0:14464:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787882741.970665:0:14464:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882741.970921:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787882741.970928:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787882741.978606:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787882741.978622:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787882741.979317:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787882741.979326:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787882741.980245:0:14464:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787882741.980274:0:14464:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.121@tcp' 00000020:01000004:0.0:1787882741.980276:0:14464:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787882741.980389:0:14464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.121@tcp (typ=mgc) 00000020:00000080:0.0:1787882741.980407:0:14464:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.121@tcp (ffff9fa2b71399b8) 00000020:00000080:0.0:1787882741.980571:0:14464:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787882741.980676:0:14464:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa2bfbc0800@MGC192.168.206.121@tcp: add connection 192.168.206.121@tcp at head 00000100:00080000:1.0:1787882741.980989:0:14478:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1787882741.981042:0:14464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.121@tcp-0 is initialized 00000040:01000000:0.0:1787882741.981050:0:14464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787882741.981718:0:14479:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787882741.981805:0:14464:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.121@tcp (uuid bfcc18db-0526-4071-939f-14c6713c8186) 00000020:00000080:1.0:1787882741.981825:0:14464:0:(genops.c:1385:class_connect()) connect: client bfcc18db-0526-4071-939f-14c6713c8186, cookie 0xf4731e8a7c5dfdb8 00000100:00080000:1.0:1787882741.981840:0:14464:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787882741.981847:0:14464:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import ffff9fa2bfbc0800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1787882741.981931:0:14464:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2c15a8e00 x1874730564013568/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787882741.981959:0:14464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bfcc18db-0526-4071-939f-14c6713c8186->MGS 00000020:01000004:1.0:1787882741.981985:0:14464:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787882741.981991:0:14464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787882741.982021:0:14464:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fa29d9f19b8) 00000020:00000080:1.0:1787882741.982033:0:14464:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787882741.982800:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfcc18db-0526-4071-939f-14c6713c8186:3304:1874730564013568:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787882741.982924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882741.983640:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564013568 00000100:00100000:3.0:1787882741.983651:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564013568 00000100:00100000:3.0:1787882741.983699:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787882741.983709:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1874730564013568:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787882741.983740:0:14475:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bfcc18db-0526-4071-939f-14c6713c8186@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:3.0:1787882741.983769:0:14475:0:(genops.c:1385:class_connect()) connect: client bfcc18db-0526-4071-939f-14c6713c8186, cookie 0xf4731e8a7c5dfdc6 00000100:00080000:3.0:1787882741.983959:0:14475:0:(import.c:65:import_set_state_nolock()) ffff9fa2c145c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787882741.984217:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+5:3304:x1874730564013568:12345-0@lo:250:mount.lustre.0 Request processed in 343us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882741.984229:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787882741.984296:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787882741.984308:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.121@tcp: connect to target with instance 0 00000100:00080000:3.0:1787882741.984318:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787882741.984323:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787882741.984327:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2bfbc0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787882741.984330:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787882741.984341:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787882741.984348:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bfcc18db-0526-4071-939f-14c6713c8186:3304:1874730564013568:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787882742.014584:0:14464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882742.014830:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787882742.014837:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787882742.018942:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787882742.018959:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787882742.020493:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787882742.020506:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787882742.021925:0:14464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787882742.022159:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787882742.022166:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787882742.025235:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787882742.025427:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787882742.129552:0:14464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882742.129961:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787882742.129968:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787882742.133663:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787882742.133682:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787882742.134561:0:14464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787882742.135709:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787882742.135717:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787882742.136547:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787882742.136555:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787882742.137474:0:14464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787882742.137709:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787882742.137721:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787882742.145441:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787882742.145458:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787882742.147460:0:14464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882742.147668:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787882742.147675:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787882742.148924:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787882742.148935:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787882742.192312:0:14464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882742.192512:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787882742.192519:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787882742.200027:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787882742.200308:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787882742.203708:0:14464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787882742.203723:0:14464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787882742.209692:0:14464:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787882742.209888:0:14464:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787882742.209897:0:14464:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787882742.210329:0:14464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787882742.210365:0:14464:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.121@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787882742.210370:0:14464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787882742.210371:0:14464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787882742.210372:0:14464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787882742.210377:0:14464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787882742.210379:0:14464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787882742.210380:0:14464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787882742.210381:0:14464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787882742.210382:0:14464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787882742.210384:0:14464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787882742.210385:0:14464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787882742.210387:0:14464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787882742.210389:0:14464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787882742.210390:0:14464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787882742.210391:0:14464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787882742.210392:0:14464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787882742.210393:0:14464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787882742.210394:0:14464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787882742.210395:0:14464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787882742.210396:0:14464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787882742.210397:0:14464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787882742.210397:0:14464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787882742.210422:0:14464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787882742.210446:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564013696:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787882742.210516:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882742.211749:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b975ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787882742.213718:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564013696 00000100:00100000:3.0:1787882742.213732:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564013696 00000100:00100000:3.0:1787882742.213839:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787882742.213849:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+5:14464:x1874730564013696:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787882742.213936:0:14477:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787882742.213939:0:14477:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787882742.213942:0:14477:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787882742.214668:0:14498:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787882742.215491:0:14477:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787882742.219685:0:14499:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787882742.219693:0:14499:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787882742.219696:0:14499:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787882742.219734:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1787882742.221026:0:14477:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787882742.221038:0:14477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787882742.232412:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+5:14464:x1874730564013696:12345-0@lo:253:mount.lustre.0 Request processed in 18554us (21885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882742.232433:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787882742.232534:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564013696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787882742.232551:0:14464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787882742.232565:0:14464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787882742.232568:0:14464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787882742.232570:0:14464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787882742.232571:0:14464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787882742.232572:0:14464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787882742.232573:0:14464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787882742.232575:0:14464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787882742.232576:0:14464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787882742.232578:0:14464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787882742.232579:0:14464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787882742.232612:0:14464:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa2bfbc0000 from lustre-MDT0000 10000000:01000000:3.0:1787882742.232636:0:14464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787882742.232638:0:14464:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787882742.232643:0:14464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fa2b71399b8 10000000:01000000:3.0:1787882742.232648:0:14464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787882742.232655:0:14464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fa2b71399b8 from 1 10000000:01000000:3.0:1787882742.232658:0:14464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787882742.232691:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.232701:0:14464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.232710:0:14464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882742.232729:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564013824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787882742.232768:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882742.232973:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564013824 00000100:00100000:0.0:1787882742.232980:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564013824 00000100:00100000:0.0:1787882742.233013:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787882742.233023:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+5:14464:x1874730564013824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787882742.233034:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882742.233049:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5dfdd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dfdcd expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.233082:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5dfdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfdcd expref: 6 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.233091:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b67d9200/0xf4731e8a7c5dfdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfdcd expref: 6 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.233100:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9200, rc 0) 00000100:00100000:0.0:1787882742.233474:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+6:14464:x1874730564013824:12345-0@lo:101:mount.lustre.0 Request processed in 451us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882742.233481:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787882742.233547:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b975a600 going to sleep for 11 seconds 00000100:00100000:3.0:1787882742.233563:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564013824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787882742.233576:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdd4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.233667:0:14464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dfdd4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882742.233721:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564013952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787882742.233750:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882742.233904:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b975a600 going to sleep for 11 seconds 00000100:00100000:2.0:1787882742.234033:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564013952 00000100:00100000:2.0:1787882742.234038:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564013952 00000100:00100000:2.0:1787882742.234231:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787882742.234241:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+6:14464:x1874730564013952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882742.234486:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+6:14464:x1874730564013952:12345-0@lo:501:mount.lustre.0 Request processed in 246us (734us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787882742.234494:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787882742.234556:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564013952:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787882742.234604:0:14464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787882742.234626:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdd4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.234634:0:14464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdd4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882742.234643:0:14464:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa2bfbc0000 10000000:01000000:0.0:1787882742.234649:0:14464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787882742.234653:0:14464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fa2bfbc0000 10000000:01000000:0.0:1787882742.234655:0:14464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787882742.234658:0:14464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fa2bfbc0000 from 1 10000000:01000000:0.0:1787882742.234661:0:14464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787882742.234684:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8400/0xf4731e8a7c5dfddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.234691:0:14464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8400/0xf4731e8a7c5dfddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.234698:0:14464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8400/0xf4731e8a7c5dfddb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882742.234712:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564014080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787882742.234742:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882742.235271:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28912e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882742.238265:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564014080 00000100:00100000:3.0:1787882742.238291:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564014080 00000100:00100000:3.0:1787882742.238350:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787882742.238360:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+6:14464:x1874730564014080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787882742.238376:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882742.238399:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5dfde2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dfddb expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.238426:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5dfde2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfddb expref: 7 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.238436:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280030c00/0xf4731e8a7c5dfde2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfddb expref: 7 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.238445:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030c00, rc 0) 00000100:00100000:3.0:1787882742.238523:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+7:14464:x1874730564014080:12345-0@lo:101:mount.lustre.0 Request processed in 163us (3779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882742.238530:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787882742.239201:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564014080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787882742.239227:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8400/0xf4731e8a7c5dfddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfde2 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.239256:0:14464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8400/0xf4731e8a7c5dfddb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dfde2 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882742.239277:0:14464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787882742.239308:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8400/0xf4731e8a7c5dfddb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfde2 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.239316:0:14464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8400/0xf4731e8a7c5dfddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfde2 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882742.239325:0:14464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787882742.239330:0:14464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787882742.239337:0:14464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fa2bfbc0000 10000000:01000000:0.0:1787882742.239340:0:14464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787882742.239345:0:14464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787882742.239347:0:14464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787882742.239375:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8000/0xf4731e8a7c5dfde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.239382:0:14464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8000/0xf4731e8a7c5dfde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.239390:0:14464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8000/0xf4731e8a7c5dfde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882742.239409:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564014208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787882742.239451:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882742.239496:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28912e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882742.239505:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564014208 00000100:00100000:3.0:1787882742.239511:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564014208 00000100:00100000:3.0:1787882742.239538:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787882742.239565:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+7:14464:x1874730564014208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787882742.239575:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882742.239585:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dfdf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dfde9 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.239602:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dfdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfde9 expref: 8 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.239611:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280030600/0xf4731e8a7c5dfdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfde9 expref: 8 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.239617:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030600, rc 0) 00000100:00100000:3.0:1787882742.239670:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+8:14464:x1874730564014208:12345-0@lo:101:mount.lustre.0 Request processed in 107us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882742.239676:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787882742.239932:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564014208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787882742.239945:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8000/0xf4731e8a7c5dfde9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdf0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.239954:0:14464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8000/0xf4731e8a7c5dfde9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dfdf0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882742.240003:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564014336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787882742.240029:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882742.240066:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28912e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882742.240155:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564014336 00000100:00100000:3.0:1787882742.240160:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564014336 00000100:00100000:3.0:1787882742.240179:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787882742.240185:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+8:14464:x1874730564014336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787882742.240590:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+9:14464:x1874730564014336:12345-0@lo:501:mount.lustre.0 Request processed in 402us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882742.240598:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787882742.240683:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564014336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787882742.240716:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564014464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787882742.240770:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882742.240800:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa28912e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882742.240916:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564014464 00000100:00100000:2.0:1787882742.240923:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564014464 00000100:00100000:2.0:1787882742.240956:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787882742.240963:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+9:14464:x1874730564014464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787882742.241437:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+9:14464:x1874730564014464:12345-0@lo:503:mount.lustre.0 Request processed in 472us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882742.241444:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787882742.241567:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564014464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787882742.243326:0:14500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14500:1874730564014592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882742.243412:0:14500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882742.243465:0:14500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882742.243483:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564014592 00000100:00100000:3.0:1787882742.243490:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564014592 00000100:00100000:3.0:1787882742.243538:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787882742.243547:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1567450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+9:14500:x1874730564014592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787882742.243863:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1567450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+9:14500:x1874730564014592:12345-0@lo:502:llog_process_th.0 Request processed in 315us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882742.243903:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787882742.243913:0:14500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14500:1874730564014592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787882742.243939:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882742.243950:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882742.243952:0:14500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787882742.243958:0:14500:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787882742.243962:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787882742.243974:0:14500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fa29d9f3370) 00000020:00000080:1.0:1787882742.243993:0:14500:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787882742.243999:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787882742.244080:0:14500:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787882742.244094:0:14500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5dfdfe 00000020:00000080:1.0:1787882742.244389:0:14500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787882742.244395:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882742.244399:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882742.244401:0:14500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787882742.244404:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882742.244408:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882742.244409:0:14500:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787882742.244412:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787882742.244420:0:14500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fa29d9f4d28) 00000020:00000080:1.0:1787882742.244430:0:14500:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787882742.244434:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787882742.244436:0:14500:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787882742.244438:0:14500:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787882742.244444:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787882742.244485:0:14500:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa2bfbc0000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787882742.244497:0:14500:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fa29d9f0000) 00000020:00000080:1.0:1787882742.244506:0:14500:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787882742.244560:0:14500:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787882742.244567:0:14500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4731e8a7c5dfe13 00000020:00000080:1.0:1787882742.245000:0:14500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787882742.245013:0:14500:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787882742.245020:0:14500:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf4731e8a7c5dfe1a 00080000:01000000:1.0:1787882742.245026:0:14500:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787882742.245030:0:14500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5dfe21 00010000:00010000:3.0:1787882742.337505:0:14500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787882742.339265:0:14500:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787882742.339568:0:14500:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787882742.344361:0:14500:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fa2866e8000) 00000020:00000080:3.0:1787882742.344386:0:14500:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787882742.344493:0:14500:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787882742.344503:0:14500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5dfe2f 00000020:00000080:2.0:1787882742.347293:0:14500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787882742.359456:0:14500:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf4731e8a7c5dfe36 00000020:00000080:3.0:1787882742.365683:0:14500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787882742.365701:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882742.365712:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882742.365714:0:14500:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787882742.365717:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787882742.365720:0:14500:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1787882742.365721:0:14500:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787882742.365723:0:14500:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787882742.365724:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787882742.365726:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882742.365728:0:14500:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787882742.365730:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882742.365734:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882742.365736:0:14500:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787882742.365740:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787882742.365782:0:14500:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787882742.365796:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882742.365799:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882742.365801:0:14500:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787882742.365803:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787882742.365807:0:14500:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787882742.365810:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882742.365811:0:14500:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787882742.365827:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787882742.365832:0:14500:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:3.0:1787882742.365858:0:14500:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787882742.365860:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787882742.365907:0:14500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fa2866ecd28) 00000020:00000080:3.0:1787882742.365923:0:14500:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787882742.365928:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787882742.365982:0:14500:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787882742.365987:0:14500:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787882742.365994:0:14500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5dfe44 00010000:00080000:3.0:1787882742.366027:0:14500:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa2b544e000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:3.0:1787882742.366252:0:14500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787882742.366648:0:14500:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787882742.366698:0:14500:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787882742.367683:0:14500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787882742.367746:0:14500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787882742.367822:0:14500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787882742.370072:0:14504:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787882742.370079:0:14504:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787882742.374171:0:14500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787882742.374255:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787882742.374309:0:14500:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787882742.374329:0:14500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4731e8a7c5dfe4b 00000100:00080000:0.0:1787882742.374340:0:14500:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787882742.374347:0:14500:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa2b544e000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1787882742.374382:0:14500:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2b9875180 x1874730564014720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787882742.374410:0:14500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787882742.374473:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787882742.374477:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882742.374479:0:14500:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787882742.374495:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787882742.374497:0:14500:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787882742.374499:0:14500:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787882742.374501:0:14500:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787882742.374502:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787882742.374505:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882742.374506:0:14500:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787882742.374509:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787882742.374513:0:14500:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787882742.374516:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787882742.374517:0:14500:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787882742.374520:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787882742.374524:0:14500:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:0.0:1787882742.374545:0:14500:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787882742.374548:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787882742.374560:0:14500:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fa2b713b370) 00000020:00000080:0.0:1787882742.374573:0:14500:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1787882742.374577:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787882742.374646:0:14500:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787882742.374651:0:14500:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787882742.374657:0:14500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4731e8a7c5dfe59 00010000:00080000:0.0:1787882742.374685:0:14500:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa2985b2000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1787882742.374923:0:14500:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1787882742.375774:0:14500:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787882742.375800:0:14500:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1787882742.376198:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564014720:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787882742.376267:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874730564014720 offset 0 length 520: 4 00000040:00080000:0.0:1787882742.376725:0:14500:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787882742.376788:0:14500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1787882742.376853:0:14500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000020:00000080:3.0:1787882742.381756:0:14500:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787882742.381770:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787882742.381800:0:14500:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787882742.381818:0:14500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4731e8a7c5dfe60 00000100:00080000:3.0:1787882742.381828:0:14500:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787882742.381835:0:14500:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa2985b2000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1787882742.381896:0:14500:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2af5d9880 x1874730564014848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787882742.381930:0:14500:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787882742.381985:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882742.381989:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882742.381991:0:14500:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787882742.381994:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882742.381998:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882742.381999:0:14500:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787882742.382003:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787882742.382004:0:14500:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787882742.382007:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882742.382009:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882742.382010:0:14500:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787882742.382013:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882742.382015:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882742.382016:0:14500:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787882742.382020:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787882742.382062:0:14500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14500:1874730564014976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787882742.382135:0:14500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882742.382182:0:14500:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b975a600 going to sleep for 11 seconds 00000040:00080000:2.0:1787882742.383227:0:14506:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787882742.383233:0:14506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1787882742.383376:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564014848:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787882742.383420:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874730564014848 offset 0 length 520: 4 00000100:00100000:0.0:1787882742.384338:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564014976 00000100:00100000:0.0:1787882742.384356:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564014976 00000100:00100000:0.0:1787882742.384409:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787882742.384417:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+9:14500:x1874730564014976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787882742.384704:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+9:14500:x1874730564014976:12345-0@lo:502:llog_process_th.0 Request processed in 287us (2568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882742.384712:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787882742.384833:0:14500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14500:1874730564014976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787882742.384886:0:14500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787882742.384893:0:14500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882742.384902:0:14500:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787882742.384910:0:14500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787882742.385171:0:14464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787882742.385192:0:14464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787882742.385213:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8000/0xf4731e8a7c5dfde9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdf0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.385223:0:14464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8000/0xf4731e8a7c5dfde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdf0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882742.385230:0:14464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa2bfbc0000 from 1 10000000:01000000:0.0:1787882742.385233:0:14464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787882742.385265:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.385273:0:14464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.385292:0:14464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882742.385312:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564015104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787882742.385350:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882742.385386:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa286054b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787882742.385438:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564015104 00000100:00100000:2.0:1787882742.385444:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564015104 00000100:00100000:2.0:1787882742.385479:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787882742.385487:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+9:14464:x1874730564015104:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787882742.385497:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882742.385510:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfe6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dfe67 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.385531:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfe6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfe67 expref: 10 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.385542:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfe6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfe67 expref: 10 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.385551:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791b600, rc 0) 00000100:00100000:2.0:1787882742.385586:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+10:14464:x1874730564015104:12345-0@lo:101:mount.lustre.0 Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882742.385592:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787882742.385695:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564015104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787882742.385716:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.385725:0:14464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882742.387492:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564015232:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787882742.387563:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882742.387609:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa286054b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787882742.387729:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564015232 00000100:00100000:3.0:1787882742.387736:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564015232 00000100:00100000:3.0:1787882742.387776:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787882742.387785:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+10:14464:x1874730564015232:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787882742.387803:0:14475:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787882742.387809:0:14475:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787882742.387909:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+10:14464:x1874730564015232:12345-0@lo:256:mount.lustre.0 Request processed in 125us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882742.387917:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787882742.388144:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564015232:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787882742.388701:0:14464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787882742.388723:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.388733:0:14464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882742.388740:0:14464:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2bfbc0000 from 1 10000000:01000000:0.0:1787882742.388743:0:14464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787882742.388771:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.388778:0:14464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.388787:0:14464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882742.388802:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564015360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787882742.388849:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882742.388914:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa286054b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787882742.389822:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564015360 00000100:00100000:2.0:1787882742.389831:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564015360 00000100:00100000:2.0:1787882742.389902:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787882742.389911:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+10:14464:x1874730564015360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787882742.389923:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882742.389941:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2a791be00/0xf4731e8a7c5dfe7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dfe75 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.389965:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2a791be00/0xf4731e8a7c5dfe7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfe75 expref: 11 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.389987:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2a791be00/0xf4731e8a7c5dfe7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfe75 expref: 11 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.389996:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791be00, rc 0) 00000100:00100000:2.0:1787882742.390065:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+11:14464:x1874730564015360:12345-0@lo:101:mount.lustre.0 Request processed in 155us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882742.390072:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787882742.390231:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564015360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787882742.390248:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882742.390256:0:14464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882742.390325:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564015488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787882742.390356:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882742.390379:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b72c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787882742.390479:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564015488 00000100:00100000:2.0:1787882742.390484:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564015488 00000100:00100000:2.0:1787882742.390516:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787882742.390522:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+11:14464:x1874730564015488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882742.392035:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+11:14464:x1874730564015488:12345-0@lo:501:mount.lustre.0 Request processed in 1505us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882742.392047:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787882742.392248:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564015488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787882742.392312:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564015616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787882742.392375:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882742.392418:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b72c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787882742.392469:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564015616 00000100:00100000:2.0:1787882742.392476:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564015616 00000100:00100000:2.0:1787882742.392554:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787882742.392562:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1566c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+11:14464:x1874730564015616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787882742.392734:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1566c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+11:14464:x1874730564015616:12345-0@lo:503:mount.lustre.0 Request processed in 173us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882742.392742:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787882742.392811:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564015616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787882742.394004:0:14508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14508:1874730564015744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882742.394068:0:14508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882742.394315:0:14508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b72c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1787882742.394395:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564015744 00000100:00100000:0.0:1787882742.394402:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564015744 00000100:00100000:0.0:1787882742.394432:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787882742.394439:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+11:14508:x1874730564015744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787882742.394681:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+11:14508:x1874730564015744:12345-0@lo:502:llog_process_th.0 Request processed in 241us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882742.394689:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787882742.394845:0:14508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14508:1874730564015744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787882742.394890:0:14508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882742.394899:0:14508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882742.394901:0:14508:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787882742.394914:0:14508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa2bfbc0000 00000020:00000080:1.0:1787882742.394917:0:14508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787882742.394924:0:14508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882742.394927:0:14508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882742.394929:0:14508:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787882742.394931:0:14508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882742.394934:0:14508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882742.394935:0:14508:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787882742.394939:0:14508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa2bfbc0000 00000020:00000080:1.0:1787882742.394941:0:14508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787882742.394994:0:14508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882742.394997:0:14508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882742.394999:0:14508:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787882742.395001:0:14508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882742.395003:0:14508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882742.395004:0:14508:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787882742.395007:0:14508:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa2bfbc0000 00000020:00000080:1.0:1787882742.395009:0:14508:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787882742.395048:0:14508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14508:1874730564015872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882742.395097:0:14508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882742.395111:0:14508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b72c9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787882742.397955:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564015872 00000100:00100000:1.0:1787882742.397967:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564015872 00000100:00100000:1.0:1787882742.398010:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787882742.398020:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+11:14508:x1874730564015872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787882742.398302:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+11:14508:x1874730564015872:12345-0@lo:502:llog_process_th.0 Request processed in 282us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882742.398310:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787882742.398375:0:14508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14508:1874730564015872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787882742.398410:0:14508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882742.398422:0:14508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882742.398424:0:14508:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787882742.398429:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787882742.399964:0:14464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787882742.399995:0:14464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787882742.400020:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.400043:0:14464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882742.400207:0:14464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787882742.400211:0:14464:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa2bfbc0000 10000000:01000000:2.0:1787882742.400214:0:14464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa2bfbc0000 10000000:01000000:2.0:1787882742.400218:0:14464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787882742.400224:0:14464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa2bfbc0000 from 1 10000000:01000000:2.0:1787882742.400227:0:14464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787882742.400265:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2a791a800/0xf4731e8a7c5dfe83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.400273:0:14464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2a791a800/0xf4731e8a7c5dfe83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.400294:0:14464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2a791a800/0xf4731e8a7c5dfe83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882742.400318:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564016000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787882742.400379:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882742.400458:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b975ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787882742.401148:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564016000 00000100:00100000:3.0:1787882742.401164:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564016000 00000100:00100000:1.0:1787882742.406927:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787882742.406947:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+11:14464:x1874730564016000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787882742.406966:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882742.406985:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa289fa7200/0xf4731e8a7c5dfe8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dfe83 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882742.407013:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa289fa7200/0xf4731e8a7c5dfe8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfe83 expref: 12 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882742.407024:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa289fa7200/0xf4731e8a7c5dfe8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfe83 expref: 12 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882742.407033:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa7200, rc 0) 00000100:00100000:1.0:1787882742.407275:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:14464:x1874730564016000:12345-0@lo:101:mount.lustre.0 Request processed in 334us (6894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882742.407293:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787882742.407849:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564016000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787882742.407898:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2a791a800/0xf4731e8a7c5dfe83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfe8a expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.407910:0:14464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2a791a800/0xf4731e8a7c5dfe83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dfe8a expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882742.407995:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564016128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882742.408033:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882742.414248:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749000 going to sleep for 11 seconds 00000100:00100000:0.0:1787882742.416154:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564016128 00000100:00100000:0.0:1787882742.416168:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564016128 00000100:00100000:0.0:1787882742.416232:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787882742.416243:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:14464:x1874730564016128:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787882742.416539:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:14464:x1874730564016128:12345-0@lo:501:mount.lustre.0 Request processed in 298us (8505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882742.416548:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787882742.417307:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564016128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882742.417363:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564016256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787882742.417418:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882742.417458:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749000 going to sleep for 11 seconds 00000100:00100000:2.0:1787882742.417476:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564016256 00000100:00100000:2.0:1787882742.417481:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564016256 00000100:00100000:2.0:1787882742.417513:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787882742.417521:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+12:14464:x1874730564016256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787882742.417678:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+12:14464:x1874730564016256:12345-0@lo:503:mount.lustre.0 Request processed in 157us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882742.417686:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787882742.417730:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564016256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787882742.420753:0:14513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14513:1874730564016384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787882742.420829:0:14513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882742.420898:0:14513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa281254540 going to sleep for 11 seconds 00000100:00100000:2.0:1787882742.420958:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564016384 00000100:00100000:2.0:1787882742.420966:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564016384 00000100:00100000:2.0:1787882742.421010:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787882742.421019:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+12:14513:x1874730564016384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882742.421265:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+12:14513:x1874730564016384:12345-0@lo:502:llog_process_th.0 Request processed in 246us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882742.421274:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787882742.421434:0:14513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14513:1874730564016384:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787882742.421489:0:14513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787882742.421503:0:14513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fa2b713cd28) 00000020:00000080:0.0:1787882742.421522:0:14513:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787882742.421609:0:14513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa2bfbc0000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787882742.421613:0:14513:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa2bfbc0000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787882742.421616:0:14513:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa2bfbc0000 4 00010000:00080000:0.0:1787882742.421655:0:14513:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa2985ba800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1787882742.427730:0:14513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787882742.431129:0:14513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787882742.431177:0:14513:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787882742.431191:0:14513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf4731e8a7c5dfe98 00000100:00080000:2.0:1787882742.431202:0:14513:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787882742.431207:0:14513:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fa2985ba800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1787882742.431241:0:14513:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa181d70000 x1874730564016512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787882742.431266:0:14513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787882742.437384:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874730564016512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787882742.437465:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882742.438217:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564016512 00000100:00100000:3.0:1787882742.438226:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564016512 00000100:00100000:3.0:1787882742.438270:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787882742.438288:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874730564016512:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787882742.438361:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874730564016512:12345-0@lo:38:llog_process_th.0 Request processed in 81us (894us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787882742.438368:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882742.438412:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787882742.438420:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2985ba800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787882742.438425:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787882742.438428:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874730564016512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787882742.439586:0:14513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14513:1874730564016640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882742.439651:0:14513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882742.439685:0:14513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf7493c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882742.439715:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564016640 00000100:00100000:2.0:1787882742.439720:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564016640 00000100:00100000:2.0:1787882742.439837:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787882742.439847:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:14513:x1874730564016640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787882742.440109:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:14513:x1874730564016640:12345-0@lo:502:llog_process_th.0 Request processed in 263us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882742.440121:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787882742.440959:0:14513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bfcc18db-0526-4071-939f-14c6713c8186:14513:1874730564016640:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787882742.440995:0:14513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787882742.441116:0:14464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787882742.441138:0:14464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787882742.441158:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2a791a800/0xf4731e8a7c5dfe83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfe8a expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.441631:0:14464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2a791a800/0xf4731e8a7c5dfe83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfe8a expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787882742.441692:0:14464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787882742.441694:0:14464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787882742.441696:0:14464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882742.441697:0:14464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882742.441698:0:14464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882742.441699:0:14464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882742.441700:0:14464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787882742.441702:0:14464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787882742.441703:0:14464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882742.441705:0:14464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787882742.441708:0:14464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787882742.441710:0:14464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787882742.441711:0:14464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787882742.441712:0:14464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882742.441713:0:14464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882742.441714:0:14464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882742.441715:0:14464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882742.441716:0:14464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787882742.441717:0:14464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787882742.441718:0:14464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882742.441719:0:14464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787882742.441796:0:14464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787882742.441812:0:14464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564016768:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787882742.443108:0:14464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882742.443149:0:14464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf7493c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882742.443373:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564016768 00000100:00100000:0.0:1787882742.443381:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564016768 00000100:00100000:0.0:1787882742.443421:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787882742.443431:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+12:14464:x1874730564016768:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787882742.443460:0:14476:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787882742.443476:0:14476:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787882742.513816:0:14476:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787882742.513837:0:14476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787882742.513915:0:14498:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787882742.513921:0:14498:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787882742.513944:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.513973:0:14498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfe6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfe67 expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.513982:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.514020:0:14498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfe6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dfe67 expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.514044:0:14498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfe6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfe67 expref: 12 pid: 14477 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882742.514317:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14498:1874730564016896:0@lo:104: 00000100:00100000:0.0:1787882742.514379:0:14498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882742.514473:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a0414cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882742.520808:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564016896 00000100:00100000:2.0:1787882742.520823:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564016896 00000100:00100000:2.0:1787882742.520985:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787882742.520996:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+3:14498:x1874730564016896:12345-0@lo:104: 00010000:00010000:2.0:1787882742.521014:0:14465:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882742.521660:0:14465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787882742.521670:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+3:14498:x1874730564016896:12345-0@lo:104: Request processed in 676us (7290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882742.521678:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787882742.521733:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882742.521740:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.521749:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882742.521754:0:14471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.521763:0:14471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882742.521770:0:14471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882742.521776:0:14471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787882742.521814:0:14471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.521820:0:14471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787882742.521828:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14498:1874730564016896:0@lo:104: 00010000:00010000:3.0:1787882742.521839:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.521845:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d9800/0xf4731e8a7c5dfe67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfe6e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882742.521848:0:14498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.521902:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882742.521905:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882742.521907:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882742.521939:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfcc18db-0526-4071-939f-14c6713c8186:3306:1874730564017024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882742.521983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882742.522066:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564017024 00000100:00100000:3.0:1787882742.522071:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564017024 00010000:00010000:3.0:1787882742.522092:0:14467:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfe6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfe67 expref: 13 pid: 14477 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882742.522111:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787882742.522129:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfcc18db-0526-4071-939f-14c6713c8186+13:3306:x1874730564017024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882742.522140:0:14467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882742.522145:0:14467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfe6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfe67 expref: 13 pid: 14477 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522156:0:14467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfe6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfe67 expref: 13 pid: 14477 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522170:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfe6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dfe67 expref: 13 pid: 14477 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522182:0:14467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522190:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787882742.522204:0:14467:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008283460s 00010000:00010000:3.0:1787882742.522214:0:14467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522222:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522230:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522236:0:14467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522241:0:14467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9400 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882742.522245:0:14467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522252:0:14467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522267:0:14467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522276:0:14467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882742.522495:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfcc18db-0526-4071-939f-14c6713c8186+12:3306:x1874730564017024:12345-0@lo:103:ldlm_bl.0 Request processed in 377us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882742.522503:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882742.522512:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfcc18db-0526-4071-939f-14c6713c8186:3306:1874730564017024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882742.522548:0:14498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522556:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882742.522571:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b67d9400/0xf4731e8a7c5dfe9f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882742.537794:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+11:14464:x1874730564016768:12345-0@lo:253:mount.lustre.0 Request processed in 94355us (94679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882742.537809:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787882742.538026:0:14464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:14464:1874730564016768:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787882742.538200:0:14464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787882742.538204:0:14464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787882742.538205:0:14464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787882742.538206:0:14464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882742.538208:0:14464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882742.538209:0:14464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882742.538210:0:14464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882742.538211:0:14464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787882742.538212:0:14464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787882742.538214:0:14464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882742.538215:0:14464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787882742.538246:0:14464:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787882742.544684:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787882742.544865:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787882742.545629:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787882742.545800:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787882742.546581:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787882742.546754:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787882742.547944:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787882742.548355:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787882742.548767:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787882742.549299:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787882742.549774:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787882742.550334:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787882742.585761:0:14464:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787882742.586644:0:14464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787882742.586730:0:14521:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787882742.586734:0:14521:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787882742.587066:0:14522:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787882742.587164:0:14522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787882742.594694:0:14522:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787882742.594775:0:14522:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787882742.594781:0:14522:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1787882742.601149:0:14464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787882742.601300:0:14464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787882742.602343:0:14464:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787882742.602357:0:14464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787882742.602723:0:14464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787882742.604859:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787882742.608809:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787882742.609027:0:14464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787882742.612107:0:14464:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787882742.620599:0:14464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787882742.698472:0:14464:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787882742.700437:0:14464:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc0a681daf988 00100000:10000000:3.0:1787882742.700461:0:14464:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787882742.702007:0:14464:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787882742.702026:0:14464:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787882742.702050:0:14464:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787882742.702073:0:14464:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787882742.956526:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787882743.468927:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787882743.849976:0:14479:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787882743.849983:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa2bfbc0000 from 6 10000000:01000000:3.0:1787882743.849988:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787882743.850034:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882743.850045:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882743.850056:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882743.850083:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564017152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787882743.850161:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882743.850234:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa286054d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787882743.850365:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564017152 00000100:00100000:2.0:1787882743.850373:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564017152 00000100:00100000:2.0:1787882743.850430:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787882743.850440:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+11:14479:x1874730564017152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787882743.850455:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882743.850471:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2a791a200/0xf4731e8a7c5dfead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dfea6 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882743.850501:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2a791a200/0xf4731e8a7c5dfead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfea6 expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882743.850513:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2a791a200/0xf4731e8a7c5dfead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfea6 expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882743.850539:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a200, rc 0) 00000100:00100000:2.0:1787882743.850595:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+12:14479:x1874730564017152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882743.850601:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787882743.850729:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564017152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882743.850750:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882743.850758:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882743.850820:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564017280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787882743.850853:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882743.850910:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa286054d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787882743.850964:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564017280 00000100:00100000:1.0:1787882743.850969:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564017280 00000100:00100000:1.0:1787882743.851003:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787882743.851010:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+12:14479:x1874730564017280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787882743.851024:0:14476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787882743.851040:0:14476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787882743.851043:0:14476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787882743.851126:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+12:14479:x1874730564017280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882743.851133:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787882743.851280:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564017280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787882743.851325:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787882743.851332:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882743.851340:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882743.978082:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787882744.492755:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787882745.003850:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882746.028718:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882747.051384:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787882747.682970:0:14764:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787882747.690005:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787882747.690011:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787882747.690014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787882747.690017:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787882747.690020:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787882747.690031:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787882747.690035:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fa2985ba800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787882747.690047:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fa2985ba800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1787882747.690070:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa181d73480 x1874730564017536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787882747.690265:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564017408:0@lo:400:kworker.0 00000100:00100000:1.0:1787882747.690345:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882747.695238:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874730564017536:0@lo:38:kworker.0 00000100:00100000:0.0:1787882747.695331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882747.695376:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564017408 00000100:00100000:0.0:1787882747.695384:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564017408 00000100:00100000:0.0:1787882747.695426:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787882747.695435:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:3307:x1874730564017408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882747.695586:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564017536 00000100:00100000:2.0:1787882747.695591:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564017536 00000100:00100000:2.0:1787882747.695614:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787882747.695620:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874730564017536:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787882747.695643:0:14484:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1787882747.695683:0:14484:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf4731e8a7c5dfeb4 00000004:00100000:2.0:1787882747.702831:0:14484:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787882747.703003:0:14484:0:(import.c:65:import_set_state_nolock()) ffff9fa2985ac800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787882747.703106:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874730564017536:12345-0@lo:38:kworker.0 Request processed in 7484us (7774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882747.703118:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882747.703593:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:3307:x1874730564017408:12345-0@lo:400:kworker.0 Request processed in 8156us (13246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882747.703603:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787882747.703762:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564017408:0@lo:400:kworker.0 00010000:00080000:1.0:1787882747.703804:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa181d73480 x1874730564017536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787882757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787882747.703817:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787882747.703825:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787882747.703829:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787882747.703832:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2985ba800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787882747.703837:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874730564017536:0@lo:38:kworker.0 00010000:00010000:2.0:1787882748.074097:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882749.101317:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882750.125581:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787882750.648606:0:14915:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6dc56f80 20000000:00000080:3.0:1787882750.648625:0:14915:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa2b7d82000 uarg=0000000000000000 20000000:01000000:3.0:1787882750.648659:0:14915:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787882750.648667:0:14915:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787882750.648672:0:14915:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787882750.650340:0:14916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787882750.651996:0:14915:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787882750.665360:0:14915:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787882750.665391:0:14915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882750.665422:0:14915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2a791be00/0xf4731e8a7c5dfe7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfe75 expref: 11 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882750.665432:0:14915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882750.665532:0:14915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2a791be00/0xf4731e8a7c5dfe7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dfe75 expref: 11 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882750.665548:0:14915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2a791be00/0xf4731e8a7c5dfe7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfe75 expref: 11 pid: 14476 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882750.665562:0:14915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14915:1874730564017664:0@lo:104: 00000100:00100000:3.0:1787882750.665622:0:14915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882750.665805:0:14915:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b6158000 going to sleep for 11 seconds 00000100:00100000:2.0:1787882750.665920:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564017664 00000100:00100000:2.0:1787882750.665928:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564017664 00000100:00100000:2.0:1787882750.665985:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787882750.665995:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+3:14915:x1874730564017664:12345-0@lo:104: 00010000:00010000:2.0:1787882750.666019:0:14465:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882750.666077:0:14465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787882750.666083:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+3:14915:x1874730564017664:12345-0@lo:104: Request processed in 90us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882750.666090:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787882750.666122:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787882750.666490:0:14915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14915:1874730564017664:0@lo:104: 00010000:00010000:1.0:1787882750.666514:0:14915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882750.666613:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882750.666622:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8a00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1787882750.666626:0:14470:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882750.666634:0:14470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882750.666641:0:14470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882750.666670:0:14470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787882750.666766:0:14470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.666773:0:14470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787882750.666800:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.666806:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa2b67d8a00/0xf4731e8a7c5dfe75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfe7c expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.666824:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882750.666825:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882750.666827:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882750.666834:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787882750.666845:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564017792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787882750.666915:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882750.666969:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564017792 00000100:00100000:0.0:1787882750.666974:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564017792 00010000:00010000:0.0:1787882750.666994:0:14468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2a791be00/0xf4731e8a7c5dfe7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfe75 expref: 12 pid: 14476 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882750.667029:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882750.667044:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfcc18db-0526-4071-939f-14c6713c8186+12:3307:x1874730564017792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787882750.667056:0:14468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882750.667061:0:14468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2a791be00/0xf4731e8a7c5dfe7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfe75 expref: 12 pid: 14476 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667071:0:14468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2a791be00/0xf4731e8a7c5dfe7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfe75 expref: 12 pid: 14476 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667084:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2a791be00/0xf4731e8a7c5dfe7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dfe75 expref: 12 pid: 14476 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667096:0:14468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667115:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667128:0:14468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667142:0:14468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667148:0:14468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667154:0:14468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667160:0:14468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882750.667164:0:14468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667178:0:14468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667190:0:14468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882750.667203:0:14468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882750.667244:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfcc18db-0526-4071-939f-14c6713c8186+11:3307:x1874730564017792:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882750.667251:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882750.667282:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564017792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787882750.667639:0:14915:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882750.667647:0:14915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882750.667652:0:14915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031c00/0xf4731e8a7c5dfebb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882751.146313:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882752.172549:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787882752.556612:0:14479:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787882752.556622:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2bfbc0000 from 10 10000000:01000000:3.0:1787882752.556629:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787882752.556698:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882752.556712:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882752.556725:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882752.556756:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564017920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787882752.556847:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882752.556967:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b61589c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882752.558738:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564017920 00000100:00100000:2.0:1787882752.558758:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564017920 00000100:00100000:2.0:1787882752.558849:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787882752.558860:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+11:14479:x1874730564017920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787882752.558897:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882752.558921:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfec9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dfec2 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882752.558957:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfec2 expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882752.558969:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfec2 expref: 12 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882752.558980:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791b600, rc 0) 00000100:00100000:2.0:1787882752.560416:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+12:14479:x1874730564017920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1545us (3557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882752.560429:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787882752.560500:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564017920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882752.560527:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882752.560541:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882752.560638:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564018048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882752.560677:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882752.560730:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b61589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882752.561275:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564018048 00000100:00100000:0.0:1787882752.561284:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564018048 00000100:00100000:0.0:1787882752.561398:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787882752.561410:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:14479:x1874730564018048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882752.562807:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:14479:x1874730564018048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1391us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882752.562821:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787882752.563447:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564018048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882752.566991:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564018176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787882752.567109:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882752.567167:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b61589c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882752.567963:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564018176 00000100:00100000:2.0:1787882752.567974:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564018176 00000100:00100000:2.0:1787882752.568037:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787882752.568047:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+12:14479:x1874730564018176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882752.568321:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+12:14479:x1874730564018176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882752.568330:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787882752.568592:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564018176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787882752.572928:0:14983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787882752.573235:0:14479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787882752.573274:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787882752.573288:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882752.573302:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882752.812738:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787882742/real 1787882742] req@ffff9fa2af5d9880 x1874730564014848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787882752 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882752.812778:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa2af5d9880 x1874730564014848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787882752 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882752.812792:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787882742/real 1787882742] req@ffff9fa2b9875180 x1874730564014720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787882752 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882752.812806:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa2b9875180 x1874730564014720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787882752 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787882752.812828:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2985b2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787882752.812838:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787882752.812842:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564014848:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787882752.812848:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2b544e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787882752.812853:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787882752.812856:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564014720:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787882752.813382:0:14057:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787882752.813389:0:14057:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787882752.813393:0:14057:0:(import.c:65:import_set_state_nolock()) ffff9fa2b544e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787882752.813401:0:14057:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:1.0:1787882752.813408:0:14057:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787882752.813424:0:14057:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa2b544e000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1787882752.813478:0:14057:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2c15ab480 x1874730564018304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787882752.813517:0:14057:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787882752.813520:0:14057:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787882752.813523:0:14057:0:(import.c:65:import_set_state_nolock()) ffff9fa2985b2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787882752.813527:0:14057:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:1.0:1787882752.813531:0:14057:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1787882752.813533:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564018304:0@lo:8:kworker.0 00000100:00080000:1.0:1787882752.813538:0:14057:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa2985b2000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1787882752.813565:0:14057:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2c15aad80 x1874730564018432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1787882752.813603:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874730564018304 offset 0 length 520: 4 00000100:00100000:1.0:1787882752.814806:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730564018560:0@lo:400:kworker.0 00000100:00100000:1.0:1787882752.814915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882752.814961:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564018560 00000100:00100000:3.0:1787882752.814974:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564018560 00000100:00100000:3.0:1787882752.815043:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787882752.815055:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730564018560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882752.816167:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564018432:0@lo:8:kworker.0 00000400:00000100:0.0:1787882752.816239:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874730564018432 offset 0 length 520: 4 00000100:00100000:3.0:1787882752.816447:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730564018560:12345-0@lo:400:kworker.0 Request processed in 1392us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882752.816461:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787882752.816831:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa2c15a9500 x1874730564018560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882752.816849:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730564018560:0@lo:400:kworker.0 00010000:00010000:3.0:1787882753.196329:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882754.218900:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787882754.732434:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787882755.242636:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787882756.021007:0:15164:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787882756.021011:0:15164:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787882756.021111:0:15164:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa288a01000 00000020:01000004:3.0:1787882756.021127:0:15164:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787882756.021150:0:15164:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787882756.021165:0:15164:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fa2866eb370) 00000020:00000080:3.0:1787882756.021179:0:15164:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787882756.059512:0:15164:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787882756.059790:0:15164:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787882756.063194:0:15164:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787882756.063438:0:15164:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787882756.063647:0:15164:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787882756.064432:0:15164:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 559: rc = 0 00100000:10000000:2.0:1787882756.064733:0:15164:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 559: rc = 0 00100000:10000000:2.0:1787882756.064833:0:15164:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 559: rc = 0 00100000:10000000:2.0:1787882756.066295:0:15164:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 699: rc = 0 00100000:10000000:2.0:1787882756.066652:0:15164:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 699: rc = 0 00100000:10000000:2.0:1787882756.067270:0:15164:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 699: rc = 0 00100000:10000000:2.0:1787882756.067538:0:15164:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 699: rc = 0 00100000:10000000:2.0:1787882756.067774:0:15164:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 699: rc = 0 00100000:10000000:2.0:1787882756.068437:0:15164:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 699: rc = 0 00000020:00000080:2.0:1787882756.070776:0:15164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787882756.070788:0:15164:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787882756.070798:0:15164:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf4731e8a7c5dfed7 00000020:01000004:2.0:1787882756.070807:0:15164:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787882756.070830:0:15164:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787882756.070834:0:15164:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787882756.070839:0:15164:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787882756.070844:0:15164:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787882756.070856:0:15164:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fa2c123b370) 00000020:00000080:2.0:1787882756.070865:0:15164:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1787882756.082737:0:15164:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787882756.082974:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787882756.082980:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787882756.088346:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787882756.088359:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787882756.090325:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787882756.090337:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787882756.095406:0:15164:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882756.095615:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787882756.095623:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787882756.098903:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787882756.098916:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787882756.121144:0:15164:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787882756.121443:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787882756.121451:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787882756.127907:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787882756.127920:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787882756.134227:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787882756.134354:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787882756.137390:0:15164:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882756.137579:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787882756.137586:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787882756.138601:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787882756.138610:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787882756.184423:0:15164:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787882756.184621:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787882756.184628:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787882756.186470:0:15164:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787882756.186485:0:15164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787882756.187257:0:15164:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787882756.187281:0:15164:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787882756.187288:0:15164:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787882756.208679:0:15164:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787882756.208719:0:15164:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.121@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787882756.208728:0:15164:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787882756.208729:0:15164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787882756.208730:0:15164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787882756.208731:0:15164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787882756.208732:0:15164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787882756.208733:0:15164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787882756.208734:0:15164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787882756.208736:0:15164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787882756.208737:0:15164:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787882756.208741:0:15164:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787882756.208743:0:15164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787882756.208744:0:15164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787882756.208745:0:15164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787882756.208746:0:15164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787882756.208747:0:15164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787882756.208748:0:15164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787882756.208749:0:15164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787882756.208750:0:15164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787882756.208751:0:15164:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787882756.210546:0:15164:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787882756.210575:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564018688:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787882756.211259:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882756.211315:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7178540 going to sleep for 11 seconds 00000100:00100000:0.0:1787882756.211383:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564018688 00000100:00100000:0.0:1787882756.211391:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564018688 00000100:00100000:0.0:1787882756.211444:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787882756.211453:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:15164:x1874730564018688:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787882756.211497:0:14475:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787882756.211500:0:14475:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787882756.211504:0:14475:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787882756.231729:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:15164:x1874730564018688:12345-0@lo:253:mount.lustre.0 Request processed in 20267us (20462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882756.231744:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787882756.232174:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564018688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787882756.232189:0:15164:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787882756.232192:0:15164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787882756.232194:0:15164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787882756.232195:0:15164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882756.232196:0:15164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882756.232197:0:15164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882756.232199:0:15164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882756.232200:0:15164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787882756.232202:0:15164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882756.232214:0:15164:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787882756.232236:0:15164:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa288a01000 from lustre-OST0000 10000000:01000000:2.0:1787882756.232263:0:15164:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787882756.232278:0:15164:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787882756.232286:0:15164:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa2b71399b8 local copy 00010000:00010000:2.0:1787882756.232297:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdd4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882756.232557:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564018816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882756.232612:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882756.232659:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b717f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787882756.233158:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564018816 00000100:00100000:3.0:1787882756.233167:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564018816 00000100:00100000:3.0:1787882756.233226:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787882756.233236:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+12:15164:x1874730564018816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787882756.233443:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+12:15164:x1874730564018816:12345-0@lo:501:mount.lustre.0 Request processed in 208us (842us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787882756.233452:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787882756.233712:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564018816:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787882756.233730:0:15164:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787882756.233942:0:15164:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787882756.233951:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdd4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.234277:0:15164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdd4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882756.234314:0:15164:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa288a01000 10000000:01000000:3.0:1787882756.234393:0:15164:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787882756.234401:0:15164:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fa2b71399b8 10000000:01000000:3.0:1787882756.234404:0:15164:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787882756.234407:0:15164:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fa2b71399b8 from 1 10000000:01000000:3.0:1787882756.234409:0:15164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787882756.234439:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030200/0xf4731e8a7c5dfee5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.234446:0:15164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa280030200/0xf4731e8a7c5dfee5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.234455:0:15164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa280030200/0xf4731e8a7c5dfee5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882756.234472:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564018944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787882756.234509:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882756.234546:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a04143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882756.234714:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564018944 00000100:00100000:1.0:1787882756.234720:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564018944 00000100:00100000:1.0:1787882756.234769:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787882756.234778:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+12:15164:x1874730564018944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787882756.234789:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882756.234801:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa289fa7000/0xf4731e8a7c5dfeec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dfee5 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.234823:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa289fa7000/0xf4731e8a7c5dfeec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfee5 expref: 13 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.234833:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa289fa7000/0xf4731e8a7c5dfeec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfee5 expref: 13 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.234840:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa7000, rc 0) 00000100:00100000:1.0:1787882756.234905:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+13:15164:x1874730564018944:12345-0@lo:101:mount.lustre.0 Request processed in 128us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882756.234912:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787882756.235844:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564018944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787882756.235863:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa280030200/0xf4731e8a7c5dfee5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfeec expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.236273:0:15164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa280030200/0xf4731e8a7c5dfee5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dfeec expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882756.236295:0:15164:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787882756.236315:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280030200/0xf4731e8a7c5dfee5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfeec expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.236322:0:15164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280030200/0xf4731e8a7c5dfee5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfeec expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882756.236330:0:15164:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787882756.236411:0:15164:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787882756.236419:0:15164:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787882756.236422:0:15164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787882756.236450:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ac00/0xf4731e8a7c5dfef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.236472:0:15164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ac00/0xf4731e8a7c5dfef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.236482:0:15164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ac00/0xf4731e8a7c5dfef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882756.236499:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787882756.236546:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882756.236595:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b717f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787882756.238499:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564019072 00000100:00100000:3.0:1787882756.238512:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564019072 00000100:00100000:3.0:1787882756.238597:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787882756.238615:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+13:15164:x1874730564019072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787882756.238630:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882756.238645:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280030000/0xf4731e8a7c5dfefa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dfef3 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.238668:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030000/0xf4731e8a7c5dfefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfef3 expref: 14 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.238677:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280030000/0xf4731e8a7c5dfefa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfef3 expref: 14 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.238685:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030000, rc 0) 00000100:00100000:3.0:1787882756.240864:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+14:15164:x1874730564019072:12345-0@lo:101:mount.lustre.0 Request processed in 2236us (4303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882756.240889:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787882756.242175:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787882756.242201:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ac00/0xf4731e8a7c5dfef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfefa expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.242224:0:15164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ac00/0xf4731e8a7c5dfef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dfefa expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787882756.242951:0:15164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787882756.243842:0:15164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787882756.244162:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787882756.244221:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787882756.244256:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787882756.244306:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787882756.244344:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787882756.244380:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787882756.244466:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787882756.244475:0:15164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787882756.244547:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882756.244606:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882756.244664:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b717fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787882756.245447:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564019200 00000100:00100000:1.0:1787882756.245456:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564019200 00000100:00100000:1.0:1787882756.245505:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787882756.245515:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+14:15164:x1874730564019200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787882756.245896:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+14:15164:x1874730564019200:12345-0@lo:501:mount.lustre.0 Request processed in 356us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882756.245905:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787882756.251858:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882756.253395:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787882756.253480:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882756.253530:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b717fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787882756.253618:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564019328 00000100:00100000:3.0:1787882756.253625:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564019328 00000100:00100000:3.0:1787882756.253679:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787882756.253689:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+14:15164:x1874730564019328:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787882756.258570:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+14:15164:x1874730564019328:12345-0@lo:503:mount.lustre.0 Request processed in 4873us (5081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882756.258584:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787882756.258814:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019328:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787882756.259590:0:15164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787882756.259665:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787882756.259721:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882756.259767:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7178cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882756.262110:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564019456 00000100:00100000:3.0:1787882756.263097:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564019456 00000100:00100000:3.0:1787882756.263747:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787882756.263759:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+14:15164:x1874730564019456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787882756.264533:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+14:15164:x1874730564019456:12345-0@lo:502:mount.lustre.0 Request processed in 773us (4808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882756.264552:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787882756.265267:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787882756.265527:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787882756.265583:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787882756.266279:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787882756.266358:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787882756.266397:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787882756.266432:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787882756.266481:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787882756.266517:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787882756.266549:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787882756.266595:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787882756.266647:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787882756.266698:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787882756.266744:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787882756.266832:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882756.267455:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7178cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787882756.267724:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882756.268740:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564019584 00000100:00100000:2.0:1787882756.268751:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564019584 00000100:00100000:2.0:1787882756.273424:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787882756.273455:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+14:15164:x1874730564019584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787882756.273764:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+14:15164:x1874730564019584:12345-0@lo:502:mount.lustre.0 Request processed in 324us (6931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882756.273773:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787882756.274009:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787882756.274355:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787882756.274377:0:15164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1787882756.277332:0:15178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787882756.277342:0:15178:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787882756.277348:0:15178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882756.277351:0:15178:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787882756.277357:0:15178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787882756.277371:0:15178:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fa2a99f8000) 00000020:00000080:1.0:1787882756.277394:0:15178:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787882756.277399:0:15178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787882756.277477:0:15178:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa288a01000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787882756.277483:0:15178:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787882756.277489:0:15178:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf4731e8a7c5dff08 00010000:00010000:1.0:1787882756.289715:0:15178:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787882756.294710:0:15178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787882756.304574:0:15178:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787882756.312284:0:15178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787882756.312297:0:15178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787882756.312303:0:15178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882756.312305:0:15178:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787882756.312309:0:15178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787882756.312312:0:15178:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1787882756.312314:0:15178:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787882756.312315:0:15178:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787882756.312316:0:15178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787882756.312318:0:15178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882756.312320:0:15178:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787882756.312322:0:15178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787882756.312325:0:15178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882756.312327:0:15178:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787882756.312329:0:15178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787882756.312331:0:15178:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787882756.312334:0:15178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787882756.312336:0:15178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882756.312348:0:15178:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787882756.312361:0:15178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787882756.312364:0:15178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882756.312368:0:15178:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787882756.312372:0:15178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787882756.312442:0:15178:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787882756.312446:0:15178:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787882756.312447:0:15178:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787882756.312450:0:15178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787882756.312699:0:15164:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787882756.312723:0:15164:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787882756.312749:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ac00/0xf4731e8a7c5dfef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfefa expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.312760:0:15164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ac00/0xf4731e8a7c5dfef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfefa expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882756.312767:0:15164:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa288a01000 from 1 10000000:01000000:1.0:1787882756.312769:0:15164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787882756.312805:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.312813:0:15164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.312824:0:15164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882756.312846:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787882756.312945:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882756.312988:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7178f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787882756.317928:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564019712 00000100:00100000:2.0:1787882756.317944:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564019712 00000100:00100000:2.0:1787882756.318007:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787882756.318016:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+14:15164:x1874730564019712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787882756.318033:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882756.318049:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2a791a400/0xf4731e8a7c5dff16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dff0f expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.318076:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2a791a400/0xf4731e8a7c5dff16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dff0f expref: 15 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.318086:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2a791a400/0xf4731e8a7c5dff16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dff0f expref: 15 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.318096:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a400, rc 0) 00000100:00100000:2.0:1787882756.318184:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+15:15164:x1874730564019712:12345-0@lo:101:mount.lustre.0 Request processed in 169us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882756.318192:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787882756.318277:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787882756.318295:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.318316:0:15164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787882756.318829:0:15164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787882756.322299:0:15164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787882756.322604:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787882756.322650:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787882756.322722:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787882756.322739:0:15164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787882756.322817:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882756.324720:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882756.324816:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b717fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787882756.333261:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564019840 00000100:00100000:1.0:1787882756.333277:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564019840 00000100:00100000:1.0:1787882756.333340:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787882756.333350:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+15:15164:x1874730564019840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787882756.333681:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+15:15164:x1874730564019840:12345-0@lo:501:mount.lustre.0 Request processed in 332us (8966us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882756.333690:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787882756.336356:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787882756.336420:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787882756.336495:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882756.336544:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749300 going to sleep for 11 seconds 00000100:00100000:1.0:1787882756.336568:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564019968 00000100:00100000:1.0:1787882756.336576:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564019968 00000100:00100000:1.0:1787882756.336624:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787882756.336634:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+15:15164:x1874730564019968:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787882756.337576:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+15:15164:x1874730564019968:12345-0@lo:503:mount.lustre.0 Request processed in 937us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882756.337588:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787882756.337665:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564019968:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787882756.339088:0:15164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787882756.339316:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787882756.339381:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882756.339422:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749300 going to sleep for 11 seconds 00000100:00100000:2.0:1787882756.341279:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564020096 00000100:00100000:2.0:1787882756.341290:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564020096 00000100:00100000:2.0:1787882756.341350:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787882756.341360:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+15:15164:x1874730564020096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787882756.341606:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+15:15164:x1874730564020096:12345-0@lo:502:mount.lustre.0 Request processed in 247us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882756.341614:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787882756.341756:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787882756.342066:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787882756.342133:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787882756.342197:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787882756.342249:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787882756.342285:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787882756.342333:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787882756.342381:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787882756.342413:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787882756.342451:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020224:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787882756.342500:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882756.342537:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b7178240 going to sleep for 11 seconds 00000100:00100000:2.0:1787882756.343310:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564020224 00000100:00100000:2.0:1787882756.343319:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564020224 00000100:00100000:2.0:1787882756.343363:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787882756.343371:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+15:15164:x1874730564020224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787882756.343579:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+15:15164:x1874730564020224:12345-0@lo:502:mount.lustre.0 Request processed in 208us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882756.343587:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787882756.343706:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787882756.343842:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787882756.343856:0:15164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787882756.351636:0:15182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882756.351651:0:15182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882756.351654:0:15182:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787882756.351662:0:15182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa288a01000 00000020:00000080:3.0:1787882756.351665:0:15182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787882756.351674:0:15182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882756.351677:0:15182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882756.351678:0:15182:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787882756.351680:0:15182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882756.351683:0:15182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882756.351684:0:15182:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787882756.351687:0:15182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa288a01000 00000020:00000080:3.0:1787882756.351690:0:15182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787882756.352174:0:15182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882756.352181:0:15182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882756.352182:0:15182:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787882756.352185:0:15182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882756.352198:0:15182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882756.352200:0:15182:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787882756.352215:0:15182:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa288a01000 00000020:00000080:3.0:1787882756.352217:0:15182:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787882756.357255:0:15182:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882756.357269:0:15182:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882756.357271:0:15182:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787882756.357278:0:15182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787882756.360343:0:15164:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787882756.360381:0:15164:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787882756.360436:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.360449:0:15164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882756.360494:0:15164:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787882756.360496:0:15164:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa288a01000 10000000:01000000:2.0:1787882756.360499:0:15164:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa288a01000 10000000:01000000:2.0:1787882756.360503:0:15164:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787882756.360508:0:15164:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa288a01000 from 1 10000000:01000000:2.0:1787882756.360511:0:15164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787882756.360543:0:15164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2a791b000/0xf4731e8a7c5dff1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.360551:0:15164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2a791b000/0xf4731e8a7c5dff1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.360562:0:15164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2a791b000/0xf4731e8a7c5dff1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882756.360585:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787882756.360649:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882756.360696:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa292065240 going to sleep for 11 seconds 00000100:00100000:0.0:1787882756.361935:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564020352 00000100:00100000:0.0:1787882756.361945:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564020352 00000100:00100000:0.0:1787882756.361989:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787882756.361997:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+15:15164:x1874730564020352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787882756.362011:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882756.362027:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b67d9c00/0xf4731e8a7c5dff24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dff1d expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882756.362052:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b67d9c00/0xf4731e8a7c5dff24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dff1d expref: 16 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882756.362063:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b67d9c00/0xf4731e8a7c5dff24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dff1d expref: 16 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882756.362072:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b67d9c00, rc 0) 00000100:00100000:0.0:1787882756.362142:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+16:15164:x1874730564020352:12345-0@lo:101:mount.lustre.0 Request processed in 145us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882756.362148:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787882756.362386:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787882756.362405:0:15164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2a791b000/0xf4731e8a7c5dff1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dff24 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882756.362415:0:15164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2a791b000/0xf4731e8a7c5dff1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dff24 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787882756.363001:0:15164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787882756.363479:0:15164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787882756.363724:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787882756.363795:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787882756.363829:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787882756.363919:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787882756.363961:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787882756.364011:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787882756.364048:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787882756.364083:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787882756.364504:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787882756.364549:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787882756.364582:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787882756.364626:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787882756.364662:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787882756.364694:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787882756.364891:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787882756.364933:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787882756.364965:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787882756.365030:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787882756.365068:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787882756.365101:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787882756.365904:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787882756.365948:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787882756.365979:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787882756.366045:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787882756.366082:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787882756.366412:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787882756.366471:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787882756.366509:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787882756.366592:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787882756.366600:0:15164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787882756.368523:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882756.368598:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882756.368641:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa292065240 going to sleep for 11 seconds 00000100:00100000:3.0:1787882756.369612:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564020480 00000100:00100000:3.0:1787882756.369623:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564020480 00000100:00100000:3.0:1787882756.369670:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787882756.369679:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+16:15164:x1874730564020480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787882756.369981:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+16:15164:x1874730564020480:12345-0@lo:501:mount.lustre.0 Request processed in 302us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882756.369989:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787882756.370256:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882756.370305:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787882756.370351:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882756.370389:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa292065240 going to sleep for 11 seconds 00000100:00100000:1.0:1787882756.371269:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564020608 00000100:00100000:1.0:1787882756.371278:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564020608 00000100:00100000:1.0:1787882756.371318:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787882756.371327:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+16:15164:x1874730564020608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787882756.371528:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+16:15164:x1874730564020608:12345-0@lo:503:mount.lustre.0 Request processed in 202us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882756.371535:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787882756.371701:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020608:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787882756.372963:0:15164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787882756.373044:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787882756.373107:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882756.373964:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b61589c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882756.378958:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564020736 00000100:00100000:3.0:1787882756.378972:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564020736 00000100:00100000:3.0:1787882756.379026:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787882756.379036:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+16:15164:x1874730564020736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787882756.379363:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+16:15164:x1874730564020736:12345-0@lo:502:mount.lustre.0 Request processed in 328us (6255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882756.379371:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787882756.379459:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787882756.379739:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787882756.381006:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787882756.381051:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787882756.381121:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787882756.381161:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787882756.381224:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787882756.381278:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787882756.381316:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787882756.381370:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787882756.381411:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787882756.381468:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787882756.381522:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787882756.381560:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787882756.381593:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787882756.381653:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787882756.381695:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787882756.381733:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787882756.382645:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787882756.382700:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787882756.384293:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787882756.384376:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787882756.384417:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787882756.384456:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787882756.384506:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787882756.384543:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787882756.384575:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787882756.384648:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787882756.384685:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787882756.384736:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787882756.386066:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787882756.386135:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787882756.386174:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787882756.389325:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787882756.389426:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787882756.389471:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787882756.389544:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787882756.389586:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787882756.389624:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787882756.389673:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787882756.389738:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787882756.390929:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787882756.391004:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882756.391047:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749600 going to sleep for 11 seconds 00000100:00100000:1.0:1787882756.391913:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564020864 00000100:00100000:1.0:1787882756.391930:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564020864 00000100:00100000:1.0:1787882756.392001:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787882756.392011:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+16:15164:x1874730564020864:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787882756.392271:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+16:15164:x1874730564020864:12345-0@lo:502:mount.lustre.0 Request processed in 261us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882756.392280:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787882756.406005:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564020864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787882756.406168:0:15164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787882756.406190:0:15164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787882756.408544:0:15187:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787882756.408562:0:15187:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fa2a99fb370) 00000020:00000080:1.0:1787882756.408582:0:15187:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787882756.408661:0:15187:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa288a01000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787882756.408665:0:15187:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa288a01000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787882756.408668:0:15187:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa288a01000 3 00010000:00080000:1.0:1787882756.408701:0:15187:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa284efb800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.121@tcp at head 00010000:00010000:1.0:1787882756.415936:0:15187:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787882756.416133:0:15187:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787882756.416168:0:15187:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787882756.416181:0:15187:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf4731e8a7c5dff32 00000100:00080000:1.0:1787882756.416191:0:15187:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787882756.416196:0:15187:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fa284efb800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1787882756.416241:0:15187:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2c15a9880 x1874730564020992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787882756.416271:0:15187:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787882756.416483:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787882756.416488:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787882756.416491:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787882756.416494:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787882756.416808:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874730564020992:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787882756.416896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882756.417129:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787882756.417140:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730564021120:0@lo:400:kworker.0 00000100:00100000:0.0:1787882756.417169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882756.419821:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564020992 00000100:00100000:2.0:1787882756.419835:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564020992 00000100:00100000:2.0:1787882756.419883:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564021120 00000100:00100000:2.0:1787882756.419886:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564021120 00000100:00100000:2.0:1787882756.419916:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787882756.419926:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730564021120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882756.420023:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730564021120:12345-0@lo:400:kworker.0 Request processed in 98us (2853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882756.420040:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787882756.420058:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787882756.420062:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874730564020992:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787882756.420083:0:14484:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:2.0:1787882756.420334:0:14484:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf4731e8a7c5dff39 00000004:00100000:2.0:1787882756.420349:0:14484:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787882756.420379:0:14484:0:(import.c:65:import_set_state_nolock()) ffff9fa2af86b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787882756.420424:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874730564020992:12345-0@lo:38:llog_process_th.0 Request processed in 360us (3527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882756.420431:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787882756.420497:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa2c15a9880 x1874730564020992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787882766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882756.420507:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787882756.420514:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1787882756.420522:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787882756.420525:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787882756.420527:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa284efb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787882756.420533:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874730564020992:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787882756.422444:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fa181d71f80 x1874730564021120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882756.422461:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730564021120:0@lo:400:kworker.0 00000040:00080000:1.0:1787882756.427348:0:15187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787882756.437420:0:15164:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787882756.437460:0:15164:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787882756.437485:0:15164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2a791b000/0xf4731e8a7c5dff1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dff24 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.437497:0:15164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2a791b000/0xf4731e8a7c5dff1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dff24 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787882756.437671:0:15164:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787882756.437673:0:15164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787882756.437675:0:15164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882756.437676:0:15164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882756.437678:0:15164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882756.437679:0:15164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882756.437681:0:15164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787882756.437683:0:15164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882756.437684:0:15164:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787882756.437694:0:15164:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787882756.437697:0:15164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787882756.437698:0:15164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787882756.437699:0:15164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882756.437700:0:15164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882756.437701:0:15164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882756.437702:0:15164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882756.437703:0:15164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787882756.437704:0:15164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882756.437705:0:15164:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787882756.437745:0:15164:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787882756.438200:0:15164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564021248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787882756.438326:0:15164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882756.438370:0:15164:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2c161cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787882756.438415:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564021248 00000100:00100000:0.0:1787882756.438422:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564021248 00000100:00100000:0.0:1787882756.438481:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787882756.438489:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+16:15164:x1874730564021248:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787882756.438517:0:14477:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787882756.438532:0:14477:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787882756.505706:0:14477:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787882756.505731:0:14477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787882756.505824:0:14498:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787882756.505829:0:14498:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787882756.505853:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.505885:0:14498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2a791a200/0xf4731e8a7c5dfead lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfea6 expref: 16 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.505908:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.505949:0:14498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2a791a200/0xf4731e8a7c5dfead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dfea6 expref: 16 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.505964:0:14498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2a791a200/0xf4731e8a7c5dfead lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfea6 expref: 16 pid: 14477 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882756.505980:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5dbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14498:1874730564021376:0@lo:104: 00000100:00100000:3.0:1787882756.506045:0:14498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882756.506125:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf7490c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882756.506332:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564021376 00000100:00100000:1.0:1787882756.506342:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564021376 00000100:00100000:1.0:1787882756.506385:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787882756.506394:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+3:14498:x1874730564021376:12345-0@lo:104: 00010000:00010000:1.0:1787882756.506407:0:14465:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506472:0:14465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787882756.506479:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+3:14498:x1874730564021376:12345-0@lo:104: Request processed in 86us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882756.506485:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787882756.506506:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882756.506512:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506518:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:1.0:1787882756.506522:0:14471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506530:0:14471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787882756.506537:0:14471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882756.506542:0:14471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787882756.506570:0:14471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506589:0:14471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787882756.506609:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506617:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280031800/0xf4731e8a7c5dfea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfead expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506634:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882756.506636:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882756.506638:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882756.506650:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787882756.506660:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfcc18db-0526-4071-939f-14c6713c8186:3308:1874730564021504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787882756.506692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882756.506723:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564021504 00000100:00100000:1.0:1787882756.506727:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564021504 00010000:00010000:1.0:1787882756.506744:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2a791a200/0xf4731e8a7c5dfead lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfea6 expref: 17 pid: 14477 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882756.506762:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787882756.506769:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfcc18db-0526-4071-939f-14c6713c8186+17:3308:x1874730564021504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787882756.506779:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882756.506784:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2a791a200/0xf4731e8a7c5dfead lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfea6 expref: 17 pid: 14477 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506793:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2a791a200/0xf4731e8a7c5dfead lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfea6 expref: 17 pid: 14477 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506809:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506825:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787882756.506838:0:14469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008283460s 00010000:00010000:1.0:1787882756.506842:0:14469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506848:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506855:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506861:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506866:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882756.506906:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506914:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506922:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882756.506932:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787882756.506961:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfcc18db-0526-4071-939f-14c6713c8186+17:3308:x1874730564021504:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882756.506968:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787882756.507026:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfcc18db-0526-4071-939f-14c6713c8186:3308:1874730564021504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882756.507371:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2a791a200/0xf4731e8a7c5dfead lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dfea6 expref: 16 pid: 14477 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882756.507382:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5dbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14498:1874730564021376:0@lo:104: 00010000:00010000:3.0:1787882756.507395:0:14498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.507404:0:14498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.507409:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882756.507414:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882756.523156:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+15:15164:x1874730564021248:12345-0@lo:253:mount.lustre.0 Request processed in 84655us (84818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882756.523267:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787882756.523419:0:15164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15164:1874730564021248:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787882756.523436:0:15164:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787882756.523440:0:15164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787882756.523441:0:15164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787882756.523443:0:15164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787882756.523444:0:15164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787882756.523445:0:15164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787882756.523447:0:15164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787882756.523448:0:15164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787882756.523450:0:15164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787882756.523451:0:15164:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787882756.523466:0:15164:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787882756.533454:0:15164:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787882756.533633:0:15164:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787882756.533785:0:15164:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787882756.534379:0:15164:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787882756.534543:0:15164:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787882756.536138:0:15164:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787882756.540566:0:15164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787882756.686646:0:15164:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787882756.686656:0:15164:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787882756.686690:0:15164:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787882756.686760:0:15164:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787882756.686776:0:15164:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787882756.686808:0:15164:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787882757.290224:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787882757.801943:0:14479:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787882757.801949:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa2bfbc0000 from 7 10000000:01000000:1.0:1787882757.801955:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787882757.801998:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882757.802009:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882757.802020:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882757.802057:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564021632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787882757.802118:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882757.802166:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564021632 00000100:00100000:1.0:1787882757.802172:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2861a2780 going to sleep for 11 seconds 00000100:00100000:3.0:1787882757.802175:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564021632 00000100:00100000:3.0:1787882757.802239:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787882757.802249:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+15:14479:x1874730564021632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882757.802261:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882757.802274:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5dff47 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882757.802297:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5dff47 expref: 16 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882757.802309:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dff47 expref: 16 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882757.802318:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280031600, rc 0) 00000100:00100000:3.0:1787882757.802378:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+16:14479:x1874730564021632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882757.802385:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787882757.802432:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564021632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787882757.802448:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882757.802457:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882757.802527:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564021760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787882757.806387:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882757.806441:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29daf09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882757.806550:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564021760 00000100:00100000:2.0:1787882757.806560:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564021760 00000100:00100000:2.0:1787882757.806660:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787882757.806672:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+16:14479:x1874730564021760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787882757.806700:0:14477:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787882757.806718:0:14477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787882757.806721:0:14477:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787882757.806824:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+16:14479:x1874730564021760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 155us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882757.806843:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787882757.806857:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564021760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787882757.806959:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787882757.806969:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882757.806979:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882758.314986:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882759.342646:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882760.364198:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882761.392152:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787882761.515144:0:14057:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787882761.515150:0:14057:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787882761.515152:0:14057:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787882761.515155:0:14057:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787882761.515206:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787882761.515222:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564021888:0@lo:400:kworker.0 00000100:00100000:2.0:1787882761.515308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882761.515367:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730564022016:0@lo:400:kworker.0 00000100:00100000:2.0:1787882761.515422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882761.515444:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787882761.515450:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564022144:0@lo:400:kworker.0 00000100:00100000:2.0:1787882761.515470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882761.515499:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564021888 00000100:00100000:2.0:1787882761.515506:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564021888 00000100:00100000:2.0:1787882761.515545:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787882761.515553:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+16:3307:x1874730564021888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882761.515599:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+16:3307:x1874730564021888:12345-0@lo:400:kworker.0 Request processed in 45us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882761.515606:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787882761.515635:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564022016 00000100:00100000:2.0:1787882761.515638:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564022016 00000100:00100000:2.0:1787882761.515662:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564022144 00000100:00100000:2.0:1787882761.515664:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564022144 00000100:00100000:2.0:1787882761.515683:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787882761.515705:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730564022016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882761.515741:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730564022016:12345-0@lo:400:kworker.0 Request processed in 37us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882761.515747:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787882761.515759:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787882761.515765:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564022144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882761.515788:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564022144:12345-0@lo:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882761.515794:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787882761.515831:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa181d73800 x1874730564022144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882761.515844:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564022144:0@lo:400:kworker.0 00010000:00080000:2.0:1787882761.515854:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa181d71500 x1874730564022016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882761.515861:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730564022016:0@lo:400:kworker.0 00000100:00100000:2.0:1787882761.515906:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564021888:0@lo:400:kworker.0 00000100:00080000:1.0:1787882761.515999:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787882762.410098:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787882762.951743:0:15532:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787882763.434022:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882764.458224:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787882764.971634:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787882765.483340:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882766.506307:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787882766.634291:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787882766.634297:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787882766.634300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787882766.634303:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787882766.634341:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564022272:0@lo:400:kworker.0 00000100:00100000:1.0:1787882766.634385:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564022528:0@lo:400:kworker.0 00000100:00100000:3.0:1787882766.634479:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730564022400:0@lo:400:kworker.0 00000100:00100000:1.0:1787882766.638649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882766.638776:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564022528 00000100:00100000:1.0:1787882766.638784:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564022528 00000100:00100000:1.0:1787882766.638836:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787882766.638845:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564022528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882766.638916:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564022528:12345-0@lo:400:kworker.0 Request processed in 72us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882766.638923:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787882766.638942:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787882766.638969:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2c15aa680 x1874730564022528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882766.638982:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564022528:0@lo:400:kworker.0 00000100:00100000:2.0:1787882766.639323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882766.639396:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564022272 00000100:00100000:2.0:1787882766.639405:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564022272 00000100:00100000:2.0:1787882766.639454:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787882766.639480:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+16:3307:x1874730564022272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882766.639546:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+16:3307:x1874730564022272:12345-0@lo:400:kworker.0 Request processed in 68us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882766.639553:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787882766.639617:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564022272:0@lo:400:kworker.0 00000100:00100000:3.0:1787882766.640031:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882766.640315:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564022400 00000100:00100000:2.0:1787882766.640324:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564022400 00000100:00100000:2.0:1787882766.640365:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787882766.640373:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730564022400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882766.640427:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730564022400:12345-0@lo:400:kworker.0 Request processed in 54us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882766.640434:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787882766.640610:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2c15a8000 x1874730564022400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882766.640624:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730564022400:0@lo:400:kworker.0 00010000:00010000:3.0:1787882767.530204:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882767.658460:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787882752/real 1787882752] req@ffff9fa2c15aad80 x1874730564018432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787882767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882767.658498:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa2c15aad80 x1874730564018432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787882767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882767.658509:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787882752/real 1787882752] req@ffff9fa2c15ab480 x1874730564018304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787882767 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882767.658521:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fa2c15ab480 x1874730564018304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787882767 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787882767.658543:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2985b2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787882767.658569:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787882767.658573:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564018432:0@lo:8:kworker.0 00000100:00080000:2.0:1787882767.658579:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2b544e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787882767.658595:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787882767.658598:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564018304:0@lo:8:kworker.0 00000100:00080000:1.0:1787882767.658774:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787882767.658779:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787882767.658782:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fa2b544e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787882767.658788:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:1.0:1787882767.658794:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787882767.658801:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fa2b544e000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1787882767.658827:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2c15ab100 x1874730564022784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787882767.658848:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787882767.658851:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787882767.658853:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fa2985b2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787882767.658856:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:1.0:1787882767.658858:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787882767.658862:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa2985b2000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1787882767.658905:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2c15a8380 x1874730564022912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787882767.659096:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfcc18db-0526-4071-939f-14c6713c8186:3306:1874730564022656:0@lo:400:kworker.0 00000100:00100000:2.0:1787882767.659184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882767.659397:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730564023168:0@lo:400:kworker.0 00000100:00100000:1.0:1787882767.659434:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882767.659654:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730564023040:0@lo:400:kworker.0 00000100:00100000:0.0:1787882767.660369:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564023168 00000100:00100000:0.0:1787882767.660381:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564023168 00000100:00100000:0.0:1787882767.660442:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787882767.660454:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730564023168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882767.660571:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564022656 00000100:00100000:1.0:1787882767.660576:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564022656 00000100:00100000:1.0:1787882767.660610:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787882767.660618:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+16:3306:x1874730564022656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882767.660716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882767.660756:0:14484:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787882767.660766:0:14484:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787882767.664484:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730564023168:12345-0@lo:400:kworker.0 Request processed in 4017us (5034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882767.664503:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787882767.664545:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564023040 00000100:00100000:0.0:1787882767.664557:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564023040 00000100:00100000:0.0:1787882767.664599:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787882767.664608:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730564023040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882767.664694:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730564023040:12345-0@lo:400:kworker.0 Request processed in 86us (3978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882767.664701:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787882767.664773:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2c15a9f80 x1874730564023168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882767.664790:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730564023168:0@lo:400:kworker.0 00010000:00080000:0.0:1787882767.664832:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2c15aa300 x1874730564023040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882767.664841:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730564023040:0@lo:400:kworker.0 00000100:00100000:1.0:1787882767.665289:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+16:3306:x1874730564022656:12345-0@lo:400:kworker.0 Request processed in 4670us (6102us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882767.665299:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787882767.667088:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfcc18db-0526-4071-939f-14c6713c8186:3306:1874730564022656:0@lo:400:kworker.0 00000100:00100000:0.0:1787882767.670151:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564022784:0@lo:8:kworker.0 00000100:00100000:0.0:1787882767.678345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882767.678414:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564022912:0@lo:8:kworker.0 00000100:00100000:0.0:1787882767.678467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882767.679081:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564022784 00000100:00100000:2.0:1787882767.679097:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564022784 00000100:00100000:2.0:1787882767.679137:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564022912 00000100:00100000:2.0:1787882767.679140:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564022912 00000100:00100000:2.0:1787882767.679168:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787882767.679179:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874730564022784:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787882767.679216:0:15167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:2.0:1787882767.679260:0:15167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4731e8a7c5dff55 00002000:00100000:2.0:1787882767.679276:0:15167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fa2af86d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787882767.679281:0:15167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787882767.679284:0:15167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787882767.679680:0:15167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787882767.679711:0:15167:0:(import.c:65:import_set_state_nolock()) ffff9fa2a05d2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787882767.679810:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874730564022784:12345-0@lo:8:kworker.0 Request processed in 631us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882767.679819:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787882767.679841:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787882767.679862:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874730564022912:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787882767.679898:0:15167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787882767.679953:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874730564022912:12345-0@lo:8:kworker.0 Request processed in 90us (1485us total) trans 0 rc -19/-19 00010000:00080000:0.0:1787882767.679959:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2c15ab100 x1874730564022784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787882787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882767.679968:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882767.679984:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787882767.679996:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787882767.680006:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787882767.680013:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787882767.680016:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2b544e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787882767.680048:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787882767.680055:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564022784:0@lo:8:kworker.0 00000100:00080000:0.0:1787882767.680071:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2985b2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787882767.680075:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787882767.680095:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564022912:0@lo:8:kworker.0 00000004:00080000:3.0:1787882767.680261:0:14504:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787882767.682562:0:14504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 483831689298ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787882767.683455:0:14505:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787882767.683492:0:14505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14505:1874730564023424:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787882767.683575:0:14505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882767.683616:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564023296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882767.683617:0:14505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787882767.684158:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564023424 00000100:00100000:0.0:1787882767.684168:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564023424 00000100:00100000:0.0:1787882767.686421:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787882767.686438:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14505:x1874730564023424:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787882767.693311:0:15168:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787882767.693322:0:15168:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787882767.693327:0:15168:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:2.0:1787882767.698266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882767.701342:0:15169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564023296 00000100:00100000:0.0:1787882767.701361:0:15169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564023296 00000100:00100000:0.0:1787882767.701425:0:15169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787882767.701440:0:15169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874730564023296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882767.701483:0:15169:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787882767.701593:0:15169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874730564023296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (3333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882767.701602:0:15169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787882767.701626:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1787882767.702420:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.702431:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.702449:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.702454:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.702461:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.702482:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.702501:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.702510:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.702535:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1787882767.703057:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa181d71500 x1874730564023296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787882767.703099:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564023296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787882767.706329:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882767.706342:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.706356:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882767.706361:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.706373:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.706397:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.706405:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.706436:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.706439:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.706440:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.710292:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.710310:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dff63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.710330:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.710335:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.710343:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dff63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.710358:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dff63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.710368:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dff63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.710376:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dff63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.710913:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787882767.711613:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.711624:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.711639:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.711643:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.711650:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.711662:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.711670:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.711678:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.711701:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787882767.711716:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787882767.711724:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dff63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.711733:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.711746:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dff63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.711756:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dff63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.712386:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dff63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.712398:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dff63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.712426:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882767.712431:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.712438:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.712442:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.712451:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.712465:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.712474:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.712516:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.712521:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.712527:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882767.712749:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.714451:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.714465:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a347b76f/0xf4731e8a7c5dff71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.714481:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.714486:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.714492:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a347b76f/0xf4731e8a7c5dff71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.714506:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a347b76f/0xf4731e8a7c5dff71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.714516:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a347b76f/0xf4731e8a7c5dff71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.714525:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a347b76f/0xf4731e8a7c5dff71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.714548:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882767.714562:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882767.714567:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a347b76f/0xf4731e8a7c5dff71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.714586:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.714591:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a347b76f/0xf4731e8a7c5dff71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.714598:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a347b76f/0xf4731e8a7c5dff71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.714612:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a347b76f/0xf4731e8a7c5dff71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.714619:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a347b76f/0xf4731e8a7c5dff71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.714636:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.714638:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.714640:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.719548:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.719563:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009311040f/0xf4731e8a7c5dff78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.719583:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.719589:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.719597:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009311040f/0xf4731e8a7c5dff78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.719614:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009311040f/0xf4731e8a7c5dff78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.719635:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009311040f/0xf4731e8a7c5dff78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.719644:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009311040f/0xf4731e8a7c5dff78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.719676:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882767.719696:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882767.719703:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009311040f/0xf4731e8a7c5dff78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.719713:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.719718:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009311040f/0xf4731e8a7c5dff78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.719728:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009311040f/0xf4731e8a7c5dff78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.719749:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009311040f/0xf4731e8a7c5dff78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.719757:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009311040f/0xf4731e8a7c5dff78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.719803:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.719812:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.719818:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.720369:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.720376:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5dff7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720387:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.720390:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.720395:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5dff7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720405:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5dff7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720413:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5dff7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720421:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5dff7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720436:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882767.720445:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882767.720449:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5dff7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720455:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.720458:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5dff7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720478:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5dff7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720489:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5dff7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720496:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068260057/0xf4731e8a7c5dff7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720512:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.720514:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.720516:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.720932:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.720939:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d925ffa/0xf4731e8a7c5dff86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720948:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.720951:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.720956:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d925ffa/0xf4731e8a7c5dff86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720965:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d925ffa/0xf4731e8a7c5dff86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720973:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d925ffa/0xf4731e8a7c5dff86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720985:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d925ffa/0xf4731e8a7c5dff86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.720998:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882767.721005:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882767.721009:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d925ffa/0xf4731e8a7c5dff86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721015:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8a00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.721019:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d925ffa/0xf4731e8a7c5dff86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721027:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d925ffa/0xf4731e8a7c5dff86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721037:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d925ffa/0xf4731e8a7c5dff86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721044:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d925ffa/0xf4731e8a7c5dff86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721056:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.721057:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.721059:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.721522:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.721538:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d850ec/0xf4731e8a7c5dff8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721549:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.721552:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.721556:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093d850ec/0xf4731e8a7c5dff8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721565:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093d850ec/0xf4731e8a7c5dff8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721573:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093d850ec/0xf4731e8a7c5dff8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721580:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093d850ec/0xf4731e8a7c5dff8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721595:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882767.721603:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882767.721607:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093d850ec/0xf4731e8a7c5dff8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721613:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9a00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.721617:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d850ec/0xf4731e8a7c5dff8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721624:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093d850ec/0xf4731e8a7c5dff8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721641:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093d850ec/0xf4731e8a7c5dff8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721647:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093d850ec/0xf4731e8a7c5dff8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.721661:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.721663:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.721664:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.731026:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.731044:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.731066:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.731071:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.731080:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.731096:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.731108:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.731116:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.731163:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882767.731182:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882767.731189:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.731198:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.731204:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.731214:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.731236:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.731244:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004186dadb/0xf4731e8a7c5dff94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.731272:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.731275:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.731277:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.736326:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.736342:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.736363:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.736374:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.736382:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.736399:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.736410:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.736418:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.736446:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787882767.736519:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882767.736530:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.736555:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882767.736561:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.736573:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.736598:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.736607:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d40bc71f/0xf4731e8a7c5dff9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.736632:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.736635:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.736636:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.737042:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.737048:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dffa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.737057:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.737060:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.737064:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dffa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.737074:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dffa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.737082:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dffa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.737095:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dffa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.737108:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787882767.737351:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882767.737358:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dffa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.737366:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882767.737370:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dffa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.737379:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dffa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.737399:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dffa2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.737407:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1d5acb8/0xf4731e8a7c5dffa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.737421:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.737423:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.737425:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.741650:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.741664:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e90ff58/0xf4731e8a7c5dffa9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.741682:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.741687:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.741694:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e90ff58/0xf4731e8a7c5dffa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.741709:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e90ff58/0xf4731e8a7c5dffa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.741720:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e90ff58/0xf4731e8a7c5dffa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.741728:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e90ff58/0xf4731e8a7c5dffa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.741747:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882767.741760:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882767.741767:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e90ff58/0xf4731e8a7c5dffa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.741782:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9400 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.741787:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e90ff58/0xf4731e8a7c5dffa9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.741797:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e90ff58/0xf4731e8a7c5dffa9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.741814:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e90ff58/0xf4731e8a7c5dffa9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.741822:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e90ff58/0xf4731e8a7c5dffa9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.741843:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.741845:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.741847:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.742280:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.742286:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000133b02a/0xf4731e8a7c5dffb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742296:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.742299:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.742303:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000133b02a/0xf4731e8a7c5dffb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742313:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000133b02a/0xf4731e8a7c5dffb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742326:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000133b02a/0xf4731e8a7c5dffb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742334:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000133b02a/0xf4731e8a7c5dffb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742347:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787882767.742685:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.742691:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014857970/0xf4731e8a7c5dffb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742699:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.742702:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.742707:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014857970/0xf4731e8a7c5dffb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742716:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014857970/0xf4731e8a7c5dffb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742724:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014857970/0xf4731e8a7c5dffb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742732:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014857970/0xf4731e8a7c5dffb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742756:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787882767.742764:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787882767.742768:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000133b02a/0xf4731e8a7c5dffb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742787:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d9800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.742791:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000133b02a/0xf4731e8a7c5dffb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742800:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000133b02a/0xf4731e8a7c5dffb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742812:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000133b02a/0xf4731e8a7c5dffb0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742820:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000133b02a/0xf4731e8a7c5dffb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742836:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882767.742840:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014857970/0xf4731e8a7c5dffb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742848:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b67d8c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.742852:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014857970/0xf4731e8a7c5dffb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742900:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014857970/0xf4731e8a7c5dffb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742915:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014857970/0xf4731e8a7c5dffb7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742922:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014857970/0xf4731e8a7c5dffb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.742936:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.742938:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.742940:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.743342:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.743352:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5dffbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.743361:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.743365:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.743369:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5dffbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.743380:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5dffbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.743389:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5dffbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.743401:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5dffbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.743417:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882767.743425:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882767.743429:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5dffbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.743437:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.743441:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5dffbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.743449:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5dffbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.743460:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5dffbe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.743467:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5dffbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.743480:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.743482:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.743483:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.745125:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787882767.751416:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787882767.753503:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.753529:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af735342/0xf4731e8a7c5dffc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.753552:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.753557:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.753564:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af735342/0xf4731e8a7c5dffc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.753582:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af735342/0xf4731e8a7c5dffc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.753595:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af735342/0xf4731e8a7c5dffc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.753603:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af735342/0xf4731e8a7c5dffc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.753627:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787882767.754378:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882767.754389:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af735342/0xf4731e8a7c5dffc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.754401:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6449200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882767.754408:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af735342/0xf4731e8a7c5dffc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.754419:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af735342/0xf4731e8a7c5dffc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.754439:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af735342/0xf4731e8a7c5dffc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.754447:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af735342/0xf4731e8a7c5dffc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.754482:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.754484:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.754486:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.756519:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.756532:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006916e268/0xf4731e8a7c5dffcc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.756550:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.756555:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.756561:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006916e268/0xf4731e8a7c5dffcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.756576:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006916e268/0xf4731e8a7c5dffcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.756595:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006916e268/0xf4731e8a7c5dffcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.756602:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006916e268/0xf4731e8a7c5dffcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.756618:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787882767.758114:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882767.758126:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006916e268/0xf4731e8a7c5dffcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.758140:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882767.758159:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006916e268/0xf4731e8a7c5dffcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.758170:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006916e268/0xf4731e8a7c5dffcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.758191:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006916e268/0xf4731e8a7c5dffcc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.758199:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006916e268/0xf4731e8a7c5dffcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.758223:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.758225:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.758227:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.760596:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.760611:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186d06cc/0xf4731e8a7c5dffd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.760629:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.760634:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.762907:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186d06cc/0xf4731e8a7c5dffd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.762938:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186d06cc/0xf4731e8a7c5dffd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.762950:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186d06cc/0xf4731e8a7c5dffd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.762959:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000186d06cc/0xf4731e8a7c5dffd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.763007:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787882767.763726:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.763735:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5dffda lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.763750:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.763755:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.763760:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5dffda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.763771:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5dffda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.763862:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5dffda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.763892:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5dffda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.763907:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787882767.764381:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.764387:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c8802d/0xf4731e8a7c5dffe1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.764397:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.764406:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.764411:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070c8802d/0xf4731e8a7c5dffe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.764420:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070c8802d/0xf4731e8a7c5dffe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.764429:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c8802d/0xf4731e8a7c5dffe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.764435:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070c8802d/0xf4731e8a7c5dffe1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.764444:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787882767.765924:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787882767.765937:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000186d06cc/0xf4731e8a7c5dffd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.765963:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6449600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882767.765970:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000186d06cc/0xf4731e8a7c5dffd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.765980:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000186d06cc/0xf4731e8a7c5dffd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766002:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000186d06cc/0xf4731e8a7c5dffd3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766010:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186d06cc/0xf4731e8a7c5dffd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766031:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787882767.766035:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5dffda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766041:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882767.766044:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5dffda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766053:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5dffda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766060:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5dffda lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766074:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5dffda lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766089:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882767.766092:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070c8802d/0xf4731e8a7c5dffe1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766100:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6449800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882767.766104:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c8802d/0xf4731e8a7c5dffe1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766112:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c8802d/0xf4731e8a7c5dffe1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766123:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070c8802d/0xf4731e8a7c5dffe1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766131:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070c8802d/0xf4731e8a7c5dffe1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.766152:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.766154:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.766156:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.766165:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.768275:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.768291:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045221836/0xf4731e8a7c5dffe8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.768310:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.768315:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.768320:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045221836/0xf4731e8a7c5dffe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.768336:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045221836/0xf4731e8a7c5dffe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.768347:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045221836/0xf4731e8a7c5dffe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.768361:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045221836/0xf4731e8a7c5dffe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.768388:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787882767.769995:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882767.770008:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045221836/0xf4731e8a7c5dffe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.770033:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6449c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882767.770039:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045221836/0xf4731e8a7c5dffe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.770050:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045221836/0xf4731e8a7c5dffe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.770071:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045221836/0xf4731e8a7c5dffe8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.770079:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045221836/0xf4731e8a7c5dffe8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882767.770107:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.770110:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882767.770112:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.773811:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.773831:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5dffef lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.773852:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.773858:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.773866:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5dffef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.773900:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5dffef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.773913:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5dffef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.773922:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5dffef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.773952:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787882767.774481:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.774488:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000745d72b9/0xf4731e8a7c5dfff6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.774505:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.774509:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.774513:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000745d72b9/0xf4731e8a7c5dfff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.774523:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000745d72b9/0xf4731e8a7c5dfff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.774531:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000745d72b9/0xf4731e8a7c5dfff6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.774539:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000745d72b9/0xf4731e8a7c5dfff6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.774564:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787882767.774931:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787882767.774939:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5dffef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.774948:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.774953:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5dffef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.774963:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5dffef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.774994:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5dffef lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775001:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5dffef lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775022:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882767.775026:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000745d72b9/0xf4731e8a7c5dfff6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775033:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882767.775036:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000745d72b9/0xf4731e8a7c5dfff6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775043:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000745d72b9/0xf4731e8a7c5dfff6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775052:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000745d72b9/0xf4731e8a7c5dfff6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775059:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000745d72b9/0xf4731e8a7c5dfff6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775070:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.775072:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.775079:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.775178:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.775226:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.775233:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b42af0b/0xf4731e8a7c5dfffd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775242:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.775246:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.775250:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b42af0b/0xf4731e8a7c5dfffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775259:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b42af0b/0xf4731e8a7c5dfffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775266:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b42af0b/0xf4731e8a7c5dfffd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775273:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b42af0b/0xf4731e8a7c5dfffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775296:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787882767.775337:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882767.775344:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b42af0b/0xf4731e8a7c5dfffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.775353:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6449000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882767.775357:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b42af0b/0xf4731e8a7c5dfffd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.775366:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b42af0b/0xf4731e8a7c5dfffd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.775379:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b42af0b/0xf4731e8a7c5dfffd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.775387:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b42af0b/0xf4731e8a7c5dfffd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.775408:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.775412:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.775636:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.775702:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.775708:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3b1a15/0xf4731e8a7c5e0004 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775717:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.775720:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.775725:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3b1a15/0xf4731e8a7c5e0004 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775746:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b3b1a15/0xf4731e8a7c5e0004 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775755:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3b1a15/0xf4731e8a7c5e0004 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775761:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b3b1a15/0xf4731e8a7c5e0004 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.775779:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787882767.776180:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882767.776186:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b3b1a15/0xf4731e8a7c5e0004 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.776204:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6449400 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882767.776208:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3b1a15/0xf4731e8a7c5e0004 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.776217:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3b1a15/0xf4731e8a7c5e0004 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.776230:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b3b1a15/0xf4731e8a7c5e0004 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.776237:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b3b1a15/0xf4731e8a7c5e0004 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787882767.776243:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787882767.776253:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.776255:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.776256:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882767.781246:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083a3f684/0xf4731e8a7c5e000b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.781272:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.781279:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.781287:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083a3f684/0xf4731e8a7c5e000b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.781305:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083a3f684/0xf4731e8a7c5e000b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.781318:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083a3f684/0xf4731e8a7c5e000b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.781342:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083a3f684/0xf4731e8a7c5e000b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.781374:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787882767.781472:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882767.781481:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083a3f684/0xf4731e8a7c5e000b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.781490:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448400 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882767.781495:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a3f684/0xf4731e8a7c5e000b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.781506:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a3f684/0xf4731e8a7c5e000b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.781534:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083a3f684/0xf4731e8a7c5e000b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.781541:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083a3f684/0xf4731e8a7c5e000b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.781563:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.781566:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.781569:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.782127:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.782135:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e0012 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.782156:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.782160:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.782164:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e0012 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.782174:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e0012 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.782182:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e0012 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.782188:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e0012 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.782208:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787882767.782383:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882767.782390:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e0012 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.782399:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882767.782403:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e0012 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.782475:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e0012 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.782490:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e0012 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.782497:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e0012 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.782526:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.782529:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.782532:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787882767.782680:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787882767.782686:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017530880/0xf4731e8a7c5e0019 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.782701:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1787882767.782704:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882767.782708:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017530880/0xf4731e8a7c5e0019 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.782718:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017530880/0xf4731e8a7c5e0019 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.782726:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017530880/0xf4731e8a7c5e0019 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.782732:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017530880/0xf4731e8a7c5e0019 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882767.782754:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787882767.782910:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00080000:0.0:1787882767.782972:0:15168:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1787882767.783088:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14505:x1874730564023424:12345-0@lo:5:osp-pre-0-0.0 Request processed in 96651us (99508us total) trans 0 rc 0/0 00010000:00010000:2.0:1787882767.783098:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017530880/0xf4731e8a7c5e0019 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882767.783100:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787882767.783111:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448a00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882767.783115:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017530880/0xf4731e8a7c5e0019 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.783123:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017530880/0xf4731e8a7c5e0019 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.783137:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017530880/0xf4731e8a7c5e0019 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.783155:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017530880/0xf4731e8a7c5e0019 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882767.783171:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.783173:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882767.783174:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882767.783222:0:14505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14505:1874730564023424:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787882767.783240:0:14505:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787882767.783304:0:14505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14505:1874730564023552:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787882767.783348:0:14505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882767.783409:0:14505:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787882767.783949:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564023552 00000100:00100000:0.0:1787882767.783958:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564023552 00000100:00100000:0.0:1787882767.784039:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787882767.784050:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14505:x1874730564023552:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787882767.784097:0:15166:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1787882767.794728:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14505:x1874730564023552:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10671us (11372us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787882767.794748:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787882767.797648:0:14505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14505:1874730564023552:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787882767.797676:0:14505:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787882768.556046:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882769.580131:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882770.608257:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787882770.832844:0:15884:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787882770.832849:0:15884:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787882770.833071:0:15884:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fa2a05d0000 00000020:01000004:2.0:1787882770.833091:0:15884:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787882770.833107:0:15884:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787882770.833134:0:15884:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fa2c12399b8) 00000020:00000080:2.0:1787882770.833153:0:15884:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787882770.878007:0:15884:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787882770.878513:0:15884:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787882770.880078:0:15884:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787882770.880470:0:15884:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787882770.880680:0:15884:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787882770.882385:0:15884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 423: rc = 0 00100000:10000000:2.0:1787882770.882485:0:15884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 423: rc = 0 00100000:10000000:2.0:1787882770.882581:0:15884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 423: rc = 0 00100000:10000000:2.0:1787882770.883334:0:15884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 896: rc = 0 00100000:10000000:2.0:1787882770.883600:0:15884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 896: rc = 0 00100000:10000000:2.0:1787882770.883843:0:15884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 896: rc = 0 00100000:10000000:2.0:1787882770.884391:0:15884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 896: rc = 0 00100000:10000000:2.0:1787882770.884646:0:15884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 896: rc = 0 00100000:10000000:2.0:1787882770.886543:0:15884:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 896: rc = 0 00000020:00000080:2.0:1787882770.887293:0:15884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787882770.887304:0:15884:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787882770.887313:0:15884:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf4731e8a7c5e0027 00000020:01000004:2.0:1787882770.887321:0:15884:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787882770.887346:0:15884:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787882770.887349:0:15884:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787882770.887355:0:15884:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787882770.887376:0:15884:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787882770.887380:0:15884:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787882770.899865:0:15884:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787882770.900059:0:15884:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.121@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787882770.900064:0:15884:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787882770.900065:0:15884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787882770.900066:0:15884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882770.900068:0:15884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882770.900069:0:15884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882770.900071:0:15884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882770.900072:0:15884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787882770.900074:0:15884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882770.900076:0:15884:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787882770.900079:0:15884:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787882770.900082:0:15884:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787882770.900083:0:15884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787882770.900084:0:15884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882770.900085:0:15884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882770.900086:0:15884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882770.900087:0:15884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882770.900088:0:15884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787882770.900089:0:15884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882770.900091:0:15884:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787882770.900189:0:15884:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787882770.900210:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564023680:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787882770.900274:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882770.900399:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287dd1240 going to sleep for 11 seconds 00000100:00100000:0.0:1787882770.900446:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564023680 00000100:00100000:0.0:1787882770.900455:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564023680 00000100:00100000:0.0:1787882770.900548:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787882770.900558:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+16:15884:x1874730564023680:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787882770.900585:0:14475:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787882770.900588:0:14475:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787882770.900592:0:14475:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787882770.939416:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+16:15884:x1874730564023680:12345-0@lo:253:mount.lustre.0 Request processed in 38845us (39126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882770.939436:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787882770.939581:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564023680:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787882770.939625:0:15884:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787882770.939629:0:15884:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787882770.939631:0:15884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787882770.939633:0:15884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787882770.939634:0:15884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787882770.939636:0:15884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787882770.939638:0:15884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787882770.939639:0:15884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787882770.939642:0:15884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787882770.939643:0:15884:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787882770.939669:0:15884:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fa2a05d0000 from lustre-OST0001 10000000:01000000:2.0:1787882770.939701:0:15884:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787882770.939705:0:15884:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787882770.939715:0:15884:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fa2b71399b8 local copy 00010000:00010000:2.0:1787882770.939728:0:15884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdd4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882770.941259:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564023808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787882770.941345:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882770.941420:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29daf0300 going to sleep for 11 seconds 00000100:00100000:1.0:1787882770.941708:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564023808 00000100:00100000:1.0:1787882770.941718:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564023808 00000100:00100000:1.0:1787882770.942046:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787882770.942231:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+16:15884:x1874730564023808:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787882770.942559:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+16:15884:x1874730564023808:12345-0@lo:501:mount.lustre.0 Request processed in 502us (1213us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787882770.942568:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787882770.947143:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564023808:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787882770.947303:0:15884:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787882770.947631:0:15884:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787882770.947645:0:15884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdd4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.947657:0:15884:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa280031e00/0xf4731e8a7c5dfdcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5dfdd4 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882770.947691:0:15884:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fa2a05d0000 10000000:01000000:1.0:1787882770.947696:0:15884:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787882770.947703:0:15884:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787882770.947706:0:15884:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787882770.947711:0:15884:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787882770.947714:0:15884:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787882770.947755:0:15884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7400/0xf4731e8a7c5e002e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.947764:0:15884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7400/0xf4731e8a7c5e002e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.947777:0:15884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7400/0xf4731e8a7c5e002e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882770.947803:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564023936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787882770.949197:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882770.949347:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2af141480 going to sleep for 11 seconds 00000100:00100000:0.0:1787882770.953010:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564023936 00000100:00100000:0.0:1787882770.953032:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564023936 00000100:00100000:1.0:1787882770.955649:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787882770.955667:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+16:15884:x1874730564023936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787882770.955690:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882770.955715:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa289fa6000/0xf4731e8a7c5e0035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5e002e expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.955752:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa289fa6000/0xf4731e8a7c5e0035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5e002e expref: 17 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.955764:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa289fa6000/0xf4731e8a7c5e0035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5e002e expref: 17 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.955775:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6000, rc 0) 00000100:00100000:1.0:1787882770.956025:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+17:15884:x1874730564023936:12345-0@lo:101:mount.lustre.0 Request processed in 362us (6835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882770.956039:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787882770.956224:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564023936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787882770.956248:0:15884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7400/0xf4731e8a7c5e002e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e0035 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882770.956259:0:15884:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7400/0xf4731e8a7c5e002e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5e0035 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787882770.957493:0:15884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787882770.958591:0:15884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787882770.959207:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787882770.959263:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787882770.959297:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787882770.959340:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787882770.959378:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787882770.959411:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787882770.959500:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787882770.959509:0:15884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787882770.959608:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024064:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787882770.959689:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882770.959840:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2af141000 going to sleep for 11 seconds 00000100:00100000:3.0:1787882770.960183:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564024064 00000100:00100000:3.0:1787882770.960194:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564024064 00000100:00100000:3.0:1787882770.960290:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787882770.960303:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+17:15884:x1874730564024064:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787882770.960707:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+17:15884:x1874730564024064:12345-0@lo:501:mount.lustre.0 Request processed in 405us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882770.960716:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787882770.960815:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882770.960863:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024192:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787882770.960941:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882770.961252:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a98916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882770.961355:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564024192 00000100:00100000:1.0:1787882770.961361:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564024192 00000100:00100000:1.0:1787882770.961400:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787882770.961410:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+17:15884:x1874730564024192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787882770.961747:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+17:15884:x1874730564024192:12345-0@lo:503:mount.lustre.0 Request processed in 338us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882770.961754:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787882770.961837:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024192:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787882770.962866:0:15884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787882770.962975:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787882770.963033:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882770.963061:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a98916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882770.963371:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564024320 00000100:00100000:1.0:1787882770.963379:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564024320 00000100:00100000:1.0:1787882770.963448:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787882770.963459:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+17:15884:x1874730564024320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787882770.963677:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+17:15884:x1874730564024320:12345-0@lo:502:mount.lustre.0 Request processed in 219us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882770.963685:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787882770.963799:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787882770.964310:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787882770.964377:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787882770.964413:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787882770.964466:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787882770.964508:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787882770.964560:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787882770.964610:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787882770.964644:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787882770.964690:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787882770.964729:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787882770.964786:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882770.964839:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29daf0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787882770.965340:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564024448 00000100:00100000:2.0:1787882770.965349:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564024448 00000100:00100000:2.0:1787882770.965403:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787882770.965413:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+17:15884:x1874730564024448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787882770.965714:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+17:15884:x1874730564024448:12345-0@lo:502:mount.lustre.0 Request processed in 302us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882770.965723:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787882770.966156:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787882770.966265:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787882770.966290:0:15884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787882770.967560:0:15885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787882770.967572:0:15885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787882770.967580:0:15885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882770.967582:0:15885:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787882770.967588:0:15885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787882770.967609:0:15885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fa2866e99b8) 00000020:00000080:3.0:1787882770.967638:0:15885:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787882770.967645:0:15885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787882770.967718:0:15885:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa2a05d0000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787882770.967727:0:15885:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787882770.967735:0:15885:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf4731e8a7c5e0043 00010000:00010000:3.0:1787882770.971809:0:15885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787882770.973499:0:15885:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787882770.975488:0:15885:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787882770.976837:0:15885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787882770.976854:0:15885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882770.976861:0:15885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882770.976863:0:15885:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787882770.976866:0:15885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882770.976916:0:15885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882770.976917:0:15885:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787882770.976922:0:15885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787882770.976924:0:15885:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787882770.976926:0:15885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882770.976928:0:15885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882770.976930:0:15885:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787882770.976932:0:15885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787882770.976934:0:15885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882770.976935:0:15885:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787882770.976939:0:15885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787882770.977008:0:15885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787882770.977012:0:15885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787882770.977013:0:15885:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787882770.977028:0:15885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787882770.977286:0:15884:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787882770.977326:0:15884:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787882770.977352:0:15884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7400/0xf4731e8a7c5e002e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e0035 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.977367:0:15884:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7400/0xf4731e8a7c5e002e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e0035 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882770.977375:0:15884:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2a05d0000 from 1 10000000:01000000:1.0:1787882770.977378:0:15884:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787882770.977424:0:15884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.977433:0:15884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.977456:0:15884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882770.977485:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787882770.977571:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882770.977628:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564024576 00000100:00100000:1.0:1787882770.977637:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564024576 00000100:00100000:1.0:1787882770.977690:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787882770.977702:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+17:15884:x1874730564024576:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787882770.977717:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882770.977732:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa289fa6400/0xf4731e8a7c5e0051 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5e004a expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.977760:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa289fa6400/0xf4731e8a7c5e0051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5e004a expref: 18 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.977772:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa289fa6400/0xf4731e8a7c5e0051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5e004a expref: 18 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.977782:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6400, rc 0) 00000100:00100000:1.0:1787882770.977821:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+18:15884:x1874730564024576:12345-0@lo:101:mount.lustre.0 Request processed in 120us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882770.977829:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787882770.977981:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2af141000 going to sleep for 11 seconds 00000100:00100000:1.0:1787882770.978008:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787882770.978025:0:15884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882770.978043:0:15884:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787882770.978613:0:15884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787882770.982740:0:15884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787882770.985328:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787882770.988801:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787882770.989088:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787882770.989098:0:15884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787882770.989244:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787882770.989327:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882770.989442:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2af141000 going to sleep for 11 seconds 00000100:00100000:0.0:1787882770.994165:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564024704 00000100:00100000:0.0:1787882770.994188:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564024704 00000100:00100000:0.0:1787882770.994306:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787882770.994320:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+18:15884:x1874730564024704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787882770.995366:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+18:15884:x1874730564024704:12345-0@lo:501:mount.lustre.0 Request processed in 1043us (6033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882770.995377:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787882771.003104:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882771.003233:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024832:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787882771.003332:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882771.003395:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a98913c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882771.003544:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564024832 00000100:00100000:1.0:1787882771.003553:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564024832 00000100:00100000:1.0:1787882771.003629:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787882771.003642:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+18:15884:x1874730564024832:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787882771.004022:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+18:15884:x1874730564024832:12345-0@lo:503:mount.lustre.0 Request processed in 381us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882771.004032:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787882771.009116:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024832:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787882771.010255:0:15884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787882771.010397:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787882771.010494:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882771.010547:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2af141b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882771.010693:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564024960 00000100:00100000:0.0:1787882771.010702:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564024960 00000100:00100000:0.0:1787882771.010760:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787882771.010771:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+18:15884:x1874730564024960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787882771.011039:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5552c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+18:15884:x1874730564024960:12345-0@lo:502:mount.lustre.0 Request processed in 269us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882771.011048:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787882771.011264:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15abb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564024960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787882771.011547:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787882771.011603:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787882771.011651:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787882771.011687:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787882771.011718:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787882771.011783:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787882771.011822:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787882771.011858:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787882771.011935:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787882771.011993:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882771.012031:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787882771.012160:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564025088 00000100:00100000:0.0:1787882771.012168:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564025088 00000100:00100000:0.0:1787882771.012213:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787882771.012223:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+18:15884:x1874730564025088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787882771.012384:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+18:15884:x1874730564025088:12345-0@lo:502:mount.lustre.0 Request processed in 163us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882771.012398:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787882771.013058:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787882771.013206:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787882771.013221:0:15884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787882771.015204:0:15889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882771.015220:0:15889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882771.015223:0:15889:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787882771.015231:0:15889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa2a05d0000 00000020:00000080:1.0:1787882771.015243:0:15889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787882771.015253:0:15889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882771.015256:0:15889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882771.015257:0:15889:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787882771.015260:0:15889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882771.015263:0:15889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882771.015264:0:15889:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787882771.015268:0:15889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fa2a05d0000 00000020:00000080:1.0:1787882771.015270:0:15889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787882771.015336:0:15889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882771.015339:0:15889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882771.015340:0:15889:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787882771.015342:0:15889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787882771.015345:0:15889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882771.015346:0:15889:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787882771.015349:0:15889:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fa2a05d0000 00000020:00000080:1.0:1787882771.015352:0:15889:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787882771.015388:0:15889:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787882771.015391:0:15889:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787882771.015393:0:15889:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787882771.015396:0:15889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787882771.018273:0:15884:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787882771.018325:0:15884:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787882771.018354:0:15884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882771.018370:0:15884:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787882771.018434:0:15884:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787882771.018438:0:15884:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fa2a05d0000 10000000:01000000:0.0:1787882771.018441:0:15884:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fa2a05d0000 10000000:01000000:0.0:1787882771.018446:0:15884:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787882771.018453:0:15884:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fa2a05d0000 from 1 10000000:01000000:0.0:1787882771.018456:0:15884:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787882771.018500:0:15884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b6448800/0xf4731e8a7c5e0058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882771.018510:0:15884:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2b6448800/0xf4731e8a7c5e0058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882771.018523:0:15884:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2b6448800/0xf4731e8a7c5e0058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882771.018552:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787882771.018634:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882771.018684:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564025216 00000100:00100000:0.0:1787882771.018692:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564025216 00000100:00100000:0.0:1787882771.018735:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787882771.018761:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+18:15884:x1874730564025216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787882771.018777:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882771.018790:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b6449a00/0xf4731e8a7c5e005f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5e0058 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882771.018818:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b6449a00/0xf4731e8a7c5e005f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5e0058 expref: 19 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882771.018829:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b6449a00/0xf4731e8a7c5e005f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5e0058 expref: 19 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882771.018839:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b6449a00, rc 0) 00000100:00100000:0.0:1787882771.020096:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+19:15884:x1874730564025216:12345-0@lo:101:mount.lustre.0 Request processed in 1328us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882771.020106:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787882771.020184:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787882771.020214:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787882771.020237:0:15884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2b6448800/0xf4731e8a7c5e0058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e005f expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882771.020250:0:15884:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2b6448800/0xf4731e8a7c5e0058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5e005f expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787882771.023103:0:15884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787882771.023672:0:15884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787882771.029187:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787882771.029312:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787882771.029348:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787882771.029416:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787882771.029465:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787882771.029518:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787882771.029553:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787882771.029588:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787882771.029641:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787882771.029677:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787882771.029712:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787882771.029779:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787882771.029820:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787882771.030376:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787882771.030444:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787882771.030481:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787882771.030517:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787882771.030563:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787882771.030598:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787882771.030630:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787882771.030680:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787882771.030718:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787882771.030752:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787882771.030815:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787882771.030857:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787882771.035142:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787882771.035266:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787882771.035303:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787882771.035343:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787882771.035458:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787882771.035522:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787882771.035585:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787882771.035651:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787882771.035742:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787882771.035806:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787882771.036013:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787882771.036061:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787882771.036213:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787882771.036222:0:15884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787882771.036366:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787882771.038176:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882771.038250:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787882771.038332:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564025344 00000100:00100000:2.0:1787882771.038342:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564025344 00000100:00100000:2.0:1787882771.038411:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787882771.038424:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+19:15884:x1874730564025344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787882771.038767:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1147050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+19:15884:x1874730564025344:12345-0@lo:501:mount.lustre.0 Request processed in 345us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882771.038777:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787882771.038998:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787882771.039054:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025472:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787882771.039099:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882771.039138:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564025472 00000100:00100000:0.0:1787882771.039143:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564025472 00000100:00100000:0.0:1787882771.039177:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787882771.039187:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+19:15884:x1874730564025472:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787882771.039427:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+19:15884:x1874730564025472:12345-0@lo:503:mount.lustre.0 Request processed in 239us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882771.039438:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787882771.039499:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787882771.039518:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025472:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787882771.043585:0:15884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787882771.043701:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787882771.043810:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882771.043893:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564025600 00000100:00100000:0.0:1787882771.046016:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564025600 00000100:00100000:0.0:1787882771.046097:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787882771.046109:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+19:15884:x1874730564025600:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787882771.046463:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1564450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+19:15884:x1874730564025600:12345-0@lo:502:mount.lustre.0 Request processed in 355us (2653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882771.046479:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787882771.046562:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787882771.049119:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787882771.049599:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787882771.049684:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787882771.049725:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787882771.049776:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787882771.049835:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787882771.051057:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787882771.051120:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787882771.051171:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787882771.051221:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787882771.051258:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787882771.051292:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787882771.051336:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787882771.051371:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787882771.051405:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787882771.051451:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787882771.051486:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787882771.051519:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787882771.051583:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787882771.051622:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787882771.051658:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787882771.051729:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787882771.051763:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787882771.051797:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787882771.051840:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787882771.055028:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787882771.055224:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787882771.055369:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787882771.055448:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787882771.055519:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787882771.055615:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787882771.055660:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787882771.055707:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787882771.055768:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787882771.055820:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787882771.055860:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787882771.057114:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787882771.057195:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787882771.057230:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787882771.057277:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787882771.057312:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787882771.057381:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787882771.057481:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882771.057598:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787882771.063027:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564025728 00000100:00100000:1.0:1787882771.063047:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564025728 00000100:00100000:3.0:1787882771.063225:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787882771.063250:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+19:15884:x1874730564025728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787882771.063545:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1567c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+19:15884:x1874730564025728:12345-0@lo:502:mount.lustre.0 Request processed in 297us (6064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882771.063554:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787882771.063611:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564025728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787882771.063789:0:15884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787882771.063809:0:15884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787882771.065436:0:15894:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787882771.065470:0:15894:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fa182a399b8) 00000020:00000080:3.0:1787882771.065497:0:15894:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787882771.065589:0:15894:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fa2a05d0000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787882771.065594:0:15894:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fa2a05d0000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787882771.065597:0:15894:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fa2a05d0000 3 00010000:00080000:3.0:1787882771.065640:0:15894:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fa284efb000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.121@tcp at head 00010000:00010000:3.0:1787882771.073714:0:15894:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787882771.084782:0:15894:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787882771.084845:0:15894:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787882771.084861:0:15894:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf4731e8a7c5e006d 00000100:00080000:3.0:1787882771.085279:0:15894:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787882771.085288:0:15894:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fa284efb000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1787882771.085336:0:15894:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2af5d9180 x1874730564025856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787882771.085415:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874730564025856:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787882771.085508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787882771.085584:0:15894:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787882771.085643:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787882771.085648:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787882771.085651:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fa2985b2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787882771.085656:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:3.0:1787882771.085662:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787882771.085667:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa2985b2000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1787882771.085681:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa2af5dad80 x1874730564026112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787882771.086074:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564025984:0@lo:400:kworker.0 00000100:00100000:2.0:1787882771.086115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882771.088146:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564025984 00000100:00100000:1.0:1787882771.088166:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564025984 00000100:00100000:1.0:1787882771.088257:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787882771.088272:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730564025984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882771.088383:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730564025984:12345-0@lo:400:kworker.0 Request processed in 116us (2267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882771.088392:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787882771.088645:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787882771.088693:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564025984:0@lo:400:kworker.0 00000100:00100000:0.0:1787882771.089023:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564026112:0@lo:8:kworker.0 00000100:00100000:0.0:1787882771.089074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882771.089123:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564025856 00000100:00100000:0.0:1787882771.089139:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564025856 00000100:00100000:0.0:1787882771.089175:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787882771.089181:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874730564025856:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787882771.089208:0:14482:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1787882771.089257:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf4731e8a7c5e0074 00000004:00100000:0.0:1787882771.089276:0:14482:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787882771.089319:0:14482:0:(import.c:65:import_set_state_nolock()) ffff9fa2a05d4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787882771.089369:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874730564025856:12345-0@lo:38:llog_process_th.0 Request processed in 187us (3861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882771.089377:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787882771.089481:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af5d9180 x1874730564025856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787882781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882771.089492:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787882771.089500:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787882771.089509:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787882771.089514:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787882771.089516:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa284efb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787882771.089522:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874730564025856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787882771.090621:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564026112 00000100:00100000:1.0:1787882771.090632:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564026112 00000100:00100000:1.0:1787882771.090679:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787882771.090687:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1874730564026112:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787882771.090771:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1874730564026112:12345-0@lo:8:kworker.0 Request processed in 83us (1695us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787882771.090779:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787882771.090863:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787882771.090890:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2985b2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787882771.090895:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787882771.090968:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564026112:0@lo:8:kworker.0 00000100:00100000:3.0:1787882771.092560:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730564026368:0@lo:400:kworker.0 00000100:00100000:3.0:1787882771.092632:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882771.092670:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787882771.092676:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730564026240:0@lo:400:kworker.0 00000100:00100000:3.0:1787882771.092701:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882771.092988:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564026368 00000100:00100000:2.0:1787882771.092996:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564026368 00000100:00100000:2.0:1787882771.093057:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564026240 00000100:00100000:2.0:1787882771.093061:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564026240 00000100:00100000:2.0:1787882771.093081:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787882771.093091:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730564026368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882771.093162:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874730564026368:12345-0@lo:400:kworker.0 Request processed in 73us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882771.093170:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787882771.093199:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787882771.093205:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730564026240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882771.093235:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874730564026240:12345-0@lo:400:kworker.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882771.093240:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787882771.093261:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787882771.093298:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af5d8700 x1874730564026240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882771.093313:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874730564026240:0@lo:400:kworker.0 00010000:00080000:2.0:1787882771.093324:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fa2af5db800 x1874730564026368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882771.093332:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874730564026368:0@lo:400:kworker.0 00000040:00080000:3.0:1787882771.094711:0:15894:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787882771.096013:0:15884:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787882771.096056:0:15884:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787882771.096088:0:15884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2b6448800/0xf4731e8a7c5e0058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e005f expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882771.096102:0:15884:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2b6448800/0xf4731e8a7c5e0058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e005f expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787882771.096171:0:15884:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787882771.096174:0:15884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787882771.096175:0:15884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787882771.096177:0:15884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787882771.096178:0:15884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787882771.096180:0:15884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787882771.096187:0:15884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787882771.096189:0:15884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787882771.096190:0:15884:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787882771.096195:0:15884:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787882771.096198:0:15884:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787882771.096199:0:15884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787882771.096200:0:15884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787882771.096201:0:15884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787882771.096202:0:15884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787882771.096203:0:15884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787882771.096204:0:15884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787882771.096205:0:15884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787882771.096206:0:15884:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787882771.096237:0:15884:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787882771.096260:0:15884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564026496:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787882771.096338:0:15884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882771.096391:0:15884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787882771.097099:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564026496 00000100:00100000:0.0:1787882771.097110:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564026496 00000100:00100000:0.0:1787882771.097182:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787882771.097192:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+19:15884:x1874730564026496:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787882771.097227:0:14476:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787882771.097243:0:14476:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787882771.136218:0:14476:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787882771.136235:0:14476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787882771.136585:0:14498:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787882771.136591:0:14498:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787882771.136620:0:14498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882771.136660:0:14498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dff47 expref: 19 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882771.136670:0:14498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882771.136723:0:14498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dff47 expref: 19 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882771.136739:0:14498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dff47 expref: 19 pid: 14475 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882771.136757:0:14498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14498:1874730564026624:0@lo:104: 00000100:00100000:3.0:1787882771.136844:0:14498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882771.136980:0:14498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a0414c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787882771.140939:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564026624 00000100:00100000:0.0:1787882771.140959:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564026624 00000100:00100000:0.0:1787882771.141024:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787882771.141036:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfcc18db-0526-4071-939f-14c6713c8186+3:14498:x1874730564026624:12345-0@lo:104: 00010000:00010000:0.0:1787882771.141059:0:14466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882771.141181:0:14466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787882771.141203:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bfcc18db-0526-4071-939f-14c6713c8186+3:14498:x1874730564026624:12345-0@lo:104: Request processed in 169us (4358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882771.141210:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787882771.141483:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882771.141492:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.141502:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7a00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:2.0:1787882771.141507:0:14470:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.141517:0:14470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787882771.141525:0:14470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882771.141532:0:14470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787882771.141591:0:14470:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.141599:0:14470:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787882771.141624:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.141632:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7a00/0xf4731e8a7c5dff47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dff4e expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.141653:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882771.141655:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882771.141657:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882771.141674:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfcc18db-0526-4071-939f-14c6713c8186:3305:1874730564026752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787882771.141727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882771.141793:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564026752 00000100:00100000:2.0:1787882771.141798:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564026752 00010000:00010000:2.0:1787882771.141822:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dff47 expref: 20 pid: 14475 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882771.141846:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787882771.141853:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfcc18db-0526-4071-939f-14c6713c8186+20:3305:x1874730564026752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787882771.141867:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882771.141904:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dff47 expref: 20 pid: 14475 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.141917:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dff47 expref: 20 pid: 14475 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.141938:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.141955:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787882771.141973:0:14469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008283460s 00010000:00010000:2.0:1787882771.141979:0:14469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.141986:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.141993:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.142000:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.142005:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280030e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882771.142009:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.142017:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.142026:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882771.142036:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882771.142067:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bfcc18db-0526-4071-939f-14c6713c8186+20:3305:x1874730564026752:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882771.142074:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787882771.142121:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfcc18db-0526-4071-939f-14c6713c8186:3305:1874730564026752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882771.142941:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280031600/0xf4731e8a7c5dff4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dff47 expref: 19 pid: 14475 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882771.142960:0:14498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14498:1874730564026624:0@lo:104: 00010000:00010000:3.0:1787882771.142978:0:14498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882771.142988:0:14498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882771.142995:0:14498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882771.143001:0:14498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e007b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882771.144143:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1567050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+18:15884:x1874730564026496:12345-0@lo:253:mount.lustre.0 Request processed in 46934us (47786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882771.144157:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787882771.144299:0:15884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9876680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bfcc18db-0526-4071-939f-14c6713c8186:15884:1874730564026496:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787882771.144314:0:15884:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787882771.144317:0:15884:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787882771.144319:0:15884:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787882771.144321:0:15884:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787882771.144322:0:15884:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787882771.144324:0:15884:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787882771.144325:0:15884:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787882771.144327:0:15884:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787882771.144329:0:15884:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787882771.144331:0:15884:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787882771.144346:0:15884:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787882771.149353:0:15884:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787882771.149520:0:15884:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787882771.151063:0:15884:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787882771.151240:0:15884:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787882771.151377:0:15884:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787882771.151584:0:15884:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787882771.154003:0:15884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787882771.253373:0:15884:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787882771.253383:0:15884:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787882771.253432:0:15884:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787882771.253488:0:15884:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787882771.253501:0:15884:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787882771.253529:0:15884:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787882771.627160:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787882772.485100:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787882772.485199:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787882772.650176:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882772.778779:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787882772.778811:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564026880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882772.778930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882772.779110:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564026880 00000100:00100000:1.0:1787882772.779146:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564026880 00000100:00100000:1.0:1787882772.779216:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787882772.779228:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564026880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882772.779273:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882772.779331:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564026880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882772.779339:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787882772.779384:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787882772.779409:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564026880:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1787882772.972223:0:14479:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787882772.972230:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fa2bfbc0000 from 8 10000000:01000000:1.0:1787882772.972236:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787882772.972275:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6c00/0xf4731e8a7c5e0082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882772.972300:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6c00/0xf4731e8a7c5e0082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882772.972311:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6c00/0xf4731e8a7c5e0082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882772.972335:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564027008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787882772.972393:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882772.972443:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2861a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787882772.972517:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564027008 00000100:00100000:3.0:1787882772.972525:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564027008 00000100:00100000:3.0:1787882772.972576:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787882772.972585:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+18:14479:x1874730564027008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882772.972595:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882772.972609:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e0089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5e0082 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882772.972631:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e0089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5e0082 expref: 19 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882772.972641:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa280030e00/0xf4731e8a7c5e0089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5e0082 expref: 19 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882772.972650:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa280030e00, rc 0) 00000100:00100000:3.0:1787882772.972688:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1564c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+19:14479:x1874730564027008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882772.972694:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787882772.973239:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564027008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882772.973255:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6c00/0xf4731e8a7c5e0082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e0089 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882772.973264:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6c00/0xf4731e8a7c5e0082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5e0089 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882772.973314:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564027136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787882772.973346:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882772.975865:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2861a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787882772.976178:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564027136 00000100:00100000:3.0:1787882772.976187:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564027136 00000100:00100000:2.0:1787882772.976355:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787882772.976367:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1567450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+19:14479:x1874730564027136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787882772.976391:0:14476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787882772.976413:0:14476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787882772.976417:0:14476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787882772.976546:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1567450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+19:14479:x1874730564027136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 181us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882772.976555:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787882772.976633:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564027136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787882772.976700:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787882772.976710:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6c00/0xf4731e8a7c5e0082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e0089 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882772.976720:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6c00/0xf4731e8a7c5e0082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e0089 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882773.677582:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787882774.186606:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787882774.698047:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882775.722949:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787882776.366224:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787882776.366232:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787882776.366235:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fa2985b2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787882776.366246:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fa2985b2000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1787882776.366269:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fa181d71c00 x1874730564027520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787882776.366334:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564027392:0@lo:400:kworker.0 00000100:00100000:2.0:1787882776.366411:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882776.366466:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787882776.366473:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfcc18db-0526-4071-939f-14c6713c8186:3308:1874730564027264:0@lo:400:kworker.0 00000100:00100000:2.0:1787882776.366500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882776.366523:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730564027904:0@lo:400:kworker.0 00000100:00100000:2.0:1787882776.366551:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882776.366578:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730564027648:0@lo:400:kworker.0 00000100:00100000:2.0:1787882776.366601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882776.366618:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787882776.366623:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564027776:0@lo:400:kworker.0 00000100:00100000:2.0:1787882776.366641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882776.366668:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564027392 00000100:00100000:2.0:1787882776.366675:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564027392 00000100:00100000:2.0:1787882776.366726:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787882776.366736:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730564027392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882776.366781:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730564027392:12345-0@lo:400:kworker.0 Request processed in 47us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882776.366788:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787882776.366807:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564027264 00000100:00100000:2.0:1787882776.366810:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564027264 00000100:00100000:2.0:1787882776.366831:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787882776.366837:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+19:3308:x1874730564027264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882776.366861:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1565850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+19:3308:x1874730564027264:12345-0@lo:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882776.366891:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787882776.367119:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564027904 00000100:00100000:2.0:1787882776.367130:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564027904 00000100:00100000:2.0:1787882776.367158:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564027648 00000100:00100000:2.0:1787882776.367160:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564027648 00000100:00100000:2.0:1787882776.367169:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564027776 00000100:00100000:2.0:1787882776.367171:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564027776 00000100:00100000:2.0:1787882776.367183:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787882776.367188:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730564027904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882776.367220:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874730564027904:12345-0@lo:400:kworker.0 Request processed in 31us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882776.367227:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787882776.367238:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787882776.367243:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730564027648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882776.367272:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874730564027648:12345-0@lo:400:kworker.0 Request processed in 29us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882776.367278:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787882776.367290:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787882776.367295:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564027776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882776.367295:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564027520:0@lo:8:kworker.0 00000100:00100000:2.0:1787882776.367321:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564027776:12345-0@lo:400:kworker.0 Request processed in 27us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882776.367321:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882776.367327:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787882776.367349:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882776.367351:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564027520 00000100:00080000:2.0:1787882776.367353:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882776.367361:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564027520 00000100:00100000:0.0:1787882776.367381:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787882776.367382:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa181d71180 x1874730564027776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787882776.367386:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1874730564027520:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787882776.367396:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564027776:0@lo:400:kworker.0 00010000:00080000:2.0:1787882776.367406:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa181d72a00 x1874730564027648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1787882776.367408:0:15168:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 492 last 0 00000100:00100000:2.0:1787882776.367426:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874730564027648:0@lo:400:kworker.0 00000020:00000080:0.0:1787882776.367437:0:15168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4731e8a7c5e0090 00002000:00100000:0.0:1787882776.367450:0:15168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fa28339a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:2.0:1787882776.367453:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bfcc18db-0526-4071-939f-14c6713c8186:3308:1874730564027264:0@lo:400:kworker.0 00002000:00080000:0.0:1787882776.367455:0:15168:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787882776.367458:0:15168:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1787882776.367462:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa181d70e00 x1874730564027904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787882792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787882776.367470:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874730564027904:0@lo:400:kworker.0 00000100:00100000:2.0:1787882776.367479:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564027392:0@lo:400:kworker.0 00002000:00080000:0.0:1787882776.367754:0:15168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787882776.367778:0:15168:0:(import.c:65:import_set_state_nolock()) ffff9fa2bf4a9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787882776.367827:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874730564027520:12345-0@lo:8:kworker.0 Request processed in 439us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882776.367834:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787882776.368341:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa181d71c00 x1874730564027520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787882801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787882776.368355:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787882776.368363:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787882776.368368:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787882776.368370:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9fa2985b2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787882776.368383:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787882776.368388:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874730564027520:0@lo:8:kworker.0 00000004:00080000:2.0:1787882776.368475:0:14507:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787882776.369322:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787882776.369340:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564028032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882776.369396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882776.369466:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564028032 00000100:00100000:3.0:1787882776.369477:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564028032 00000100:00100000:3.0:1787882776.369522:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787882776.369530:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730564028032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787882776.369558:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882776.369599:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874730564028032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882776.369605:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787882776.369640:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fa181d71c00 x1874730564028032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787882792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787882776.369656:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564028032:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787882776.369673:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787882776.369748:0:14507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa181d73b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14507:1874730564028160:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787882776.369775:0:14507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882776.369801:0:14507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29290d6c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787882776.369815:0:14506:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787882776.370226:0:14506:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 492519355127ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787882776.370987:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564028160 00000100:00100000:3.0:1787882776.370995:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564028160 00000100:00100000:3.0:1787882776.371033:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787882776.371041:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14507:x1874730564028160:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787882776.381411:0:15168:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787882776.381423:0:15168:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787882776.381429:0:15168:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1787882776.391514:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.391526:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bbd8a79/0xf4731e8a7c5e0097 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.391543:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.391547:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.391553:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bbd8a79/0xf4731e8a7c5e0097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.391582:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bbd8a79/0xf4731e8a7c5e0097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.391593:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bbd8a79/0xf4731e8a7c5e0097 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.391600:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bbd8a79/0xf4731e8a7c5e0097 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.391616:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787882776.391629:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882776.391634:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bbd8a79/0xf4731e8a7c5e0097 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.391641:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882776.391646:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bbd8a79/0xf4731e8a7c5e0097 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.391655:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bbd8a79/0xf4731e8a7c5e0097 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.391671:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bbd8a79/0xf4731e8a7c5e0097 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.391679:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bbd8a79/0xf4731e8a7c5e0097 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.391704:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.391706:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.391708:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.392304:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.392311:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000624a3311/0xf4731e8a7c5e009e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.392321:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.392325:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.392329:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000624a3311/0xf4731e8a7c5e009e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.392340:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000624a3311/0xf4731e8a7c5e009e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.392348:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000624a3311/0xf4731e8a7c5e009e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.392355:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000624a3311/0xf4731e8a7c5e009e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.392372:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787882776.393018:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.393024:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f8c71cd/0xf4731e8a7c5e00a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393044:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.393047:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.393051:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f8c71cd/0xf4731e8a7c5e00a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393071:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f8c71cd/0xf4731e8a7c5e00a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393079:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f8c71cd/0xf4731e8a7c5e00a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393087:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f8c71cd/0xf4731e8a7c5e00a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393114:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787882776.393127:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787882776.393132:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000624a3311/0xf4731e8a7c5e009e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393139:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882776.393143:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000624a3311/0xf4731e8a7c5e009e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393151:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000624a3311/0xf4731e8a7c5e009e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393177:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000624a3311/0xf4731e8a7c5e009e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393185:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000624a3311/0xf4731e8a7c5e009e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393201:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882776.393205:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f8c71cd/0xf4731e8a7c5e00a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393212:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882776.393216:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f8c71cd/0xf4731e8a7c5e00a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393224:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f8c71cd/0xf4731e8a7c5e00a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393234:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f8c71cd/0xf4731e8a7c5e00a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393241:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f8c71cd/0xf4731e8a7c5e00a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393253:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.393255:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.393263:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.393676:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.393683:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671c5ea3/0xf4731e8a7c5e00ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393693:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.393697:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.393702:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000671c5ea3/0xf4731e8a7c5e00ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393711:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000671c5ea3/0xf4731e8a7c5e00ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393719:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000671c5ea3/0xf4731e8a7c5e00ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393725:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000671c5ea3/0xf4731e8a7c5e00ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393740:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787882776.393748:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882776.393752:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000671c5ea3/0xf4731e8a7c5e00ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393759:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280031c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882776.393763:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000671c5ea3/0xf4731e8a7c5e00ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393784:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000671c5ea3/0xf4731e8a7c5e00ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393797:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000671c5ea3/0xf4731e8a7c5e00ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393805:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000671c5ea3/0xf4731e8a7c5e00ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.393818:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.393820:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.393822:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.396629:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.396643:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e00b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.396658:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.396663:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.396669:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e00b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.396683:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e00b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.396692:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e00b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.396706:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e00b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.396722:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787882776.396734:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882776.396740:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e00b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.396747:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882776.396752:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e00b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.396760:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e00b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.396776:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e00b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.396783:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e00b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.396799:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.396801:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.396803:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882776.396889:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.398824:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.398841:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e00ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.398855:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.398860:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.398866:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e00ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.398897:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e00ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.398907:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e00ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.398916:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e00ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.398934:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787882776.398945:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882776.398950:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e00ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.398958:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882776.398962:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e00ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.398969:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e00ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.398990:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e00ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.398997:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e00ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.399014:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.399016:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.399018:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.404188:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.404202:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb14889a/0xf4731e8a7c5e00c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.404220:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.404225:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.404232:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb14889a/0xf4731e8a7c5e00c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.404621:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb14889a/0xf4731e8a7c5e00c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.404634:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb14889a/0xf4731e8a7c5e00c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.404643:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb14889a/0xf4731e8a7c5e00c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.404672:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787882776.404772:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882776.404779:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb14889a/0xf4731e8a7c5e00c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.404788:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882776.404793:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb14889a/0xf4731e8a7c5e00c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.404802:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb14889a/0xf4731e8a7c5e00c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.404821:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb14889a/0xf4731e8a7c5e00c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.404838:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb14889a/0xf4731e8a7c5e00c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.404856:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882776.404858:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882776.404860:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.405805:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.405814:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e00c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.405826:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.405830:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.405835:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e00c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.405846:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e00c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.405854:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e00c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.405862:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e00c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.406195:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787882776.406205:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882776.406210:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e00c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.406217:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882776.406228:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e00c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.406237:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e00c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.406507:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e00c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.406516:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e00c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.406533:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.406535:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.406537:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.407073:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.407081:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e00cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407091:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.407110:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.407116:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e00cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407128:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e00cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407137:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e00cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407150:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e00cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407163:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787882776.407654:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.407661:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e00d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407671:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.407674:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.407679:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e00d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407688:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e00d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407696:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e00d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407704:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e00d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407720:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787882776.407732:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787882776.407736:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e00cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407762:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265a00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882776.407767:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e00cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407775:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e00cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407789:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e00cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407797:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e00cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407813:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882776.407816:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e00d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407823:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882776.407826:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e00d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407833:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e00d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407842:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e00d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407855:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e00d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.407866:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.407889:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.407891:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882776.408749:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.409363:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.409371:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1ccf9e0/0xf4731e8a7c5e00dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.409384:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.409387:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.409393:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1ccf9e0/0xf4731e8a7c5e00dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.409404:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1ccf9e0/0xf4731e8a7c5e00dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.409412:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1ccf9e0/0xf4731e8a7c5e00dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.409419:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1ccf9e0/0xf4731e8a7c5e00dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.409469:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787882776.409862:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.409889:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e00e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.409898:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.409901:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.409905:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e00e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.409915:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e00e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.409923:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e00e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.409930:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e00e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.413477:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787882776.413492:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1ccf9e0/0xf4731e8a7c5e00dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.413520:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882776.413525:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1ccf9e0/0xf4731e8a7c5e00dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.413536:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1ccf9e0/0xf4731e8a7c5e00dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.413559:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1ccf9e0/0xf4731e8a7c5e00dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.413566:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1ccf9e0/0xf4731e8a7c5e00dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.413587:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882776.413591:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e00e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.413597:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264a00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882776.413600:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e00e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.413608:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e00e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.413617:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e00e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.413631:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.413633:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.413635:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.414288:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787882776.414298:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e00e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.414437:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.415185:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.415194:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b23ca37/0xf4731e8a7c5e00eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.415209:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.415213:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.415227:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b23ca37/0xf4731e8a7c5e00eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.415241:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b23ca37/0xf4731e8a7c5e00eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.417645:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b23ca37/0xf4731e8a7c5e00eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.417655:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b23ca37/0xf4731e8a7c5e00eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.417672:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787882776.418923:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.418933:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a07884f/0xf4731e8a7c5e00f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.418948:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.418952:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.418959:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a07884f/0xf4731e8a7c5e00f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.418971:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a07884f/0xf4731e8a7c5e00f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.418980:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a07884f/0xf4731e8a7c5e00f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.418999:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a07884f/0xf4731e8a7c5e00f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.419014:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787882776.419675:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787882776.419684:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b23ca37/0xf4731e8a7c5e00eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.419693:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265400 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882776.419698:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b23ca37/0xf4731e8a7c5e00eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.419706:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b23ca37/0xf4731e8a7c5e00eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.419726:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b23ca37/0xf4731e8a7c5e00eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.419733:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b23ca37/0xf4731e8a7c5e00eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.419836:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882776.419840:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a07884f/0xf4731e8a7c5e00f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.419845:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882776.419848:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a07884f/0xf4731e8a7c5e00f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.420115:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a07884f/0xf4731e8a7c5e00f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.420132:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a07884f/0xf4731e8a7c5e00f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.420140:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a07884f/0xf4731e8a7c5e00f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.420155:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882776.420157:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882776.420159:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.420555:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.420563:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607d174e/0xf4731e8a7c5e00f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.420573:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.420578:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.420583:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000607d174e/0xf4731e8a7c5e00f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.420593:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000607d174e/0xf4731e8a7c5e00f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.420602:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000607d174e/0xf4731e8a7c5e00f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.420609:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000607d174e/0xf4731e8a7c5e00f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.420625:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787882776.421376:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.421384:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5e0100 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.421400:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.421404:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.421409:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5e0100 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.421419:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5e0100 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.421428:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5e0100 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.421436:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5e0100 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.421446:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787882776.421587:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787882776.421594:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000607d174e/0xf4731e8a7c5e00f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.421602:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264400 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882776.421606:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000607d174e/0xf4731e8a7c5e00f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.421615:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000607d174e/0xf4731e8a7c5e00f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.421629:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000607d174e/0xf4731e8a7c5e00f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.421636:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000607d174e/0xf4731e8a7c5e00f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.421651:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882776.421655:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5e0100 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.421661:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882776.421670:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5e0100 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.421678:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5e0100 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.421688:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5e0100 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.421694:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b56618/0xf4731e8a7c5e0100 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.421707:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.421709:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.421710:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882776.422846:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.423464:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.423473:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e0107 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.423489:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.423493:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.423499:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e0107 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.423511:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e0107 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.423530:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e0107 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.423538:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e0107 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.423558:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787882776.424081:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882776.424088:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e0107 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.424107:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264a00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882776.424112:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e0107 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.424120:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e0107 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.424135:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e0107 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.424148:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2f2710a/0xf4731e8a7c5e0107 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.424162:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.424164:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.424166:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787882776.424551:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787882776.424853:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.424860:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e010e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.424889:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.424892:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.424897:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e010e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.424908:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e010e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.424916:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e010e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.424924:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e010e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.427717:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787882776.427820:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787882776.427829:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e010e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.427844:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882776.427848:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e010e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.427859:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e010e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.435592:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e010e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.435624:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d15f7c/0xf4731e8a7c5e010e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882776.435647:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882776.435650:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882776.435652:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787882776.442997:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787882776.443008:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c612236/0xf4731e8a7c5e0115 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443025:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1787882776.443029:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882776.443036:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c612236/0xf4731e8a7c5e0115 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443049:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c612236/0xf4731e8a7c5e0115 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443059:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c612236/0xf4731e8a7c5e0115 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443068:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c612236/0xf4731e8a7c5e0115 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443084:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787882776.443109:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882776.443119:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c612236/0xf4731e8a7c5e0115 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443385:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882776.443390:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c612236/0xf4731e8a7c5e0115 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443399:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c612236/0xf4731e8a7c5e0115 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443415:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c612236/0xf4731e8a7c5e0115 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443422:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c612236/0xf4731e8a7c5e0115 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443438:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.443440:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.443442:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787882776.443852:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787882776.443859:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075aafbad/0xf4731e8a7c5e011c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443889:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1787882776.443893:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882776.443898:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075aafbad/0xf4731e8a7c5e011c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443923:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075aafbad/0xf4731e8a7c5e011c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443931:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075aafbad/0xf4731e8a7c5e011c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443937:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075aafbad/0xf4731e8a7c5e011c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.443951:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787882776.444510:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787882776.444517:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5e0123 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444525:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1787882776.444528:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882776.444532:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5e0123 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444542:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5e0123 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444549:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5e0123 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444566:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5e0123 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444578:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787882776.444588:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787882776.444592:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075aafbad/0xf4731e8a7c5e011c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444599:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791ba00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882776.444603:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075aafbad/0xf4731e8a7c5e011c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444611:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075aafbad/0xf4731e8a7c5e011c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444623:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075aafbad/0xf4731e8a7c5e011c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444630:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075aafbad/0xf4731e8a7c5e011c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444643:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882776.444646:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5e0123 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444662:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791be00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882776.444666:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5e0123 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444673:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5e0123 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444683:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5e0123 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444691:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000463b6b58/0xf4731e8a7c5e0123 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.444703:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.444705:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.444706:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882776.446255:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.449480:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.449493:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e012a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.449508:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.449512:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.449518:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e012a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.449538:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e012a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.449548:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e012a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.449555:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e012a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.449616:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787882776.450066:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.450072:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e0131 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.450080:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.450089:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.450093:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e0131 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.450114:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e0131 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.450121:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e0131 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.450135:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e0131 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.460913:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787882776.460929:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e012a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.460943:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265a00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882776.460948:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e012a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.460959:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e012a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.460988:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e012a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.460996:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b2a7816/0xf4731e8a7c5e012a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.461016:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787882776.461019:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e0131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.461026:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882776.461030:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e0131 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.461037:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e0131 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.461047:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e0131 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882776.461055:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.461056:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.461058:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882776.461548:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787882776.461558:0:15168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055303d09/0xf4731e8a7c5e0131 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.461580:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787882776.462283:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.462291:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0138 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.462304:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.462308:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.462314:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0138 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.462326:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0138 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.462342:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0138 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.462349:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0138 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.462366:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787882776.462747:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.462752:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e013f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.462761:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.462764:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.462768:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e013f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.462776:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e013f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.462784:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e013f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.462790:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e013f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.462811:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787882776.463233:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.463240:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5e0146 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.463248:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.463251:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.463255:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5e0146 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.463264:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5e0146 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.463272:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5e0146 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.463280:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5e0146 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.463288:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787882776.463654:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787882776.463661:0:15168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784ca8de/0xf4731e8a7c5e014d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.463669:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=492s v=(0 0) 00010000:00010000:3.0:1787882776.463678:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882776.463682:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000784ca8de/0xf4731e8a7c5e014d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.463691:0:15168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000784ca8de/0xf4731e8a7c5e014d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.463698:0:15168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000784ca8de/0xf4731e8a7c5e014d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.463705:0:15168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000784ca8de/0xf4731e8a7c5e014d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882776.463713:0:15168:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:3.0:1787882776.463913:0:15168:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1787882776.464010:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14507:x1874730564028160:12345-0@lo:5:osp-pre-1-0.0 Request processed in 92966us (94229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882776.464020:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787882776.464075:0:14507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa181d73b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14507:1874730564028160:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787882776.464089:0:14507:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787882776.464146:0:14507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14507:1874730564028288:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787882776.464182:0:14507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882776.464222:0:14507:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a91ebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882776.464239:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564028288 00000100:00100000:3.0:1787882776.464245:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564028288 00000100:00100000:3.0:1787882776.464280:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787882776.464288:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14507:x1874730564028288:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787882776.464326:0:15167:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1787882776.464992:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787882776.465001:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0138 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465012:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882776.465017:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0138 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465027:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0138 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465045:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0138 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465053:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0138 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465071:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787882776.465083:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e013f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465089:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882776.465093:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e013f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465111:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e013f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465122:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e013f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465129:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028e9d73b/0xf4731e8a7c5e013f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465142:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787882776.465145:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5e0146 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465151:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264800 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882776.465154:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5e0146 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465162:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5e0146 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465182:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5e0146 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465190:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f29c74eb/0xf4731e8a7c5e0146 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465201:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882776.465204:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000784ca8de/0xf4731e8a7c5e014d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465210:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882776.465213:0:14471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000784ca8de/0xf4731e8a7c5e014d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465221:0:14471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000784ca8de/0xf4731e8a7c5e014d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465229:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000784ca8de/0xf4731e8a7c5e014d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465236:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000784ca8de/0xf4731e8a7c5e014d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882776.465246:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882776.465247:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882776.465252:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882776.468175:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882776.490835:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14507:x1874730564028288:12345-0@lo:5:osp-pre-1-0.0 Request processed in 26540us (26645us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787882776.490847:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787882776.491091:0:14507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14507:1874730564028288:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787882776.491125:0:14507:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1787882776.749128:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882777.772633:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787882777.895745:0:16244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787882777.898150:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564028416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882777.898218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882777.898414:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564028416 00000100:00100000:1.0:1787882777.898422:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564028416 00000100:00100000:1.0:1787882777.898472:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787882777.898481:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564028416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882777.898512:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882777.898560:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564028416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882777.898568:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787882777.898607:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564028416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787882778.804912:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882779.825058:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882780.510668:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882780.510709:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542015104 00000100:00100000:0.0:1787882780.510720:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542015104 00000100:00100000:0.0:1787882780.510763:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:0.0:1787882780.510773:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2355:x1874730542015104:12345-192.168.206.21@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787882780.510805:0:14476:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0d82aa22-d25e-44d7-9348-ff42d56742a8@192.168.206.21@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1787882780.510842:0:14476:0:(genops.c:1385:class_connect()) connect: client 0d82aa22-d25e-44d7-9348-ff42d56742a8, cookie 0xf4731e8a7c5e0154 00000100:00080000:0.0:1787882780.511027:0:14476:0:(import.c:65:import_set_state_nolock()) ffff9fa2bf4ae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787882780.511120:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1566450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+5:2355:x1874730542015104:12345-192.168.206.21@tcp:250:mount.lustre.0 Request processed in 347us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882780.511129:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:0.0:1787882780.516569:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882780.516915:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542015232 00000100:00100000:2.0:1787882780.516929:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542015232 00000100:00100000:2.0:1787882780.516997:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:2.0:1787882780.517010:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+5:13791:x1874730542015232:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787882780.517031:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882780.517055:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2a791b800/0xf4731e8a7c5e015b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8433db expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.517099:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2a791b800/0xf4731e8a7c5e015b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433db expref: 6 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.517111:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2a791b800/0xf4731e8a7c5e015b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433db expref: 6 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.517121:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791b800, rc 0) 00000100:00100000:2.0:1787882780.517196:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1565450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+6:13791:x1874730542015232:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 189us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882780.517204:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:2.0:1787882780.524314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882780.524594:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542015360 00000100:00100000:0.0:1787882780.524607:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542015360 00000100:00100000:0.0:1787882780.524673:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:0.0:1787882780.524684:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+6:13791:x1874730542015360:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787882780.525139:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1566050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+6:13791:x1874730542015360:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 455us (838us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787882780.525149:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:0.0:1787882780.531774:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882780.532801:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542015488 00000100:00100000:2.0:1787882780.532817:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542015488 00000100:00100000:2.0:1787882780.532903:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 77 00000100:00100000:2.0:1787882780.532917:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+6:13791:x1874730542015488:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787882780.532938:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882780.532977:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2a791aa00/0xf4731e8a7c5e0162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8433e2 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.533012:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2a791aa00/0xf4731e8a7c5e0162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433e2 expref: 7 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.533025:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2a791aa00/0xf4731e8a7c5e0162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8433e2 expref: 7 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.533035:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791aa00, rc 0) 00000100:00100000:2.0:1787882780.533151:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1564050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+7:13791:x1874730542015488:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 237us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882780.533158:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 77 00000100:00100000:2.0:1787882780.537952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882780.538058:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542015616 00000100:00100000:0.0:1787882780.538084:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542015616 00000100:00100000:0.0:1787882780.538158:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:0.0:1787882780.538171:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1566c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+7:13791:x1874730542015616:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787882780.538700:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1566c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+8:13791:x1874730542015616:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 529us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882780.538719:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:3.0:1787882780.543769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882780.546651:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542015744 00000100:00100000:2.0:1787882780.546670:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542015744 00000100:00100000:2.0:1787882780.546801:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:2.0:1787882780.546814:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+8:13791:x1874730542015744:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787882780.547333:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1565050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+8:13791:x1874730542015744:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 519us (3577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882780.547343:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:3.0:1787882780.555082:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882780.555134:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542015872 00000100:00100000:0.0:1787882780.555151:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542015872 00000100:00100000:0.0:1787882780.555222:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:0.0:1787882780.555234:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+8:13809:x1874730542015872:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787882780.555665:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1566850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+8:13809:x1874730542015872:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 432us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882780.555674:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:0.0:1787882780.564832:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882780.565476:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542016000 00000100:00100000:2.0:1787882780.565490:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542016000 00000100:00100000:2.0:1787882780.565665:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:2.0:1787882780.565677:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+8:13809:x1874730542016000:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787882780.567943:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1567850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+8:13809:x1874730542016000:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 2252us (3110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882780.567981:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:2.0:1787882780.579585:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882780.582135:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542016128 00000100:00100000:3.0:1787882780.582155:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542016128 00000100:00100000:3.0:1787882780.582243:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:3.0:1787882780.582256:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+8:13791:x1874730542016128:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787882780.582277:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882780.582301:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b7265e00/0xf4731e8a7c5e0169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84340c expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.586306:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b7265e00/0xf4731e8a7c5e0169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84340c expref: 9 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.586334:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b7265e00/0xf4731e8a7c5e0169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84340c expref: 9 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.586346:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265e00, rc 0) 00000100:00100000:2.0:1787882780.586485:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1565c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+9:13791:x1874730542016128:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 4229us (6911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882780.586495:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:0.0:1787882780.597004:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882780.597434:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542016256 00000100:00100000:2.0:1787882780.597448:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542016256 00000100:00100000:2.0:1787882780.597617:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 83 00000100:00100000:2.0:1787882780.597631:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+9:13791:x1874730542016256:12345-192.168.206.21@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787882780.597662:0:14475:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787882780.597691:0:14475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787882780.597695:0:14475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787882780.597698:0:14475:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787882780.597701:0:14475:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787882780.600198:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+9:13791:x1874730542016256:12345-192.168.206.21@tcp:256:mount.lustre.0 Request processed in 2552us (3191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882780.600216:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 83 00000100:00100000:3.0:1787882780.603375:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882780.603657:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542016384 00000100:00100000:2.0:1787882780.603670:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542016384 00000100:00100000:2.0:1787882780.603740:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:2.0:1787882780.603751:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+9:13791:x1874730542016384:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787882780.603771:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882780.603810:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2a791a000/0xf4731e8a7c5e0170 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843413 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.603857:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2a791a000/0xf4731e8a7c5e0170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843413 expref: 10 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.604031:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2a791a000/0xf4731e8a7c5e0170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843413 expref: 10 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882780.604043:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a000, rc 0) 00000100:00100000:2.0:1787882780.604122:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:13791:x1874730542016384:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 373us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882780.604129:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:1.0:1787882780.614275:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882780.614380:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542016512 00000100:00100000:3.0:1787882780.614394:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542016512 00000100:00100000:3.0:1787882780.614530:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:3.0:1787882780.614544:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:13791:x1874730542016512:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787882780.615612:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:13791:x1874730542016512:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 1065us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882780.615635:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:0.0:1787882780.617651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882780.617833:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542016640 00000100:00100000:2.0:1787882780.618135:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542016640 00000100:00100000:2.0:1787882780.618250:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:2.0:1787882780.618264:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:13791:x1874730542016640:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787882780.618736:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:13791:x1874730542016640:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 473us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882780.618755:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:2.0:1787882780.623177:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882780.623308:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542016768 00000100:00100000:3.0:1787882780.623321:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542016768 00000100:00100000:3.0:1787882780.623400:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 87 00000100:00100000:3.0:1787882780.623413:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:13814:x1874730542016768:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787882780.623842:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:13814:x1874730542016768:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 431us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882780.623853:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 87 00000100:00100000:2.0:1787882780.634168:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882780.637145:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542016896 00000100:00100000:0.0:1787882780.637169:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542016896 00000100:00100000:0.0:1787882780.637329:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:0.0:1787882780.637343:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:13814:x1874730542016896:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787882780.637702:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:13814:x1874730542016896:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 361us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882780.637712:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:2.0:1787882780.651420:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882780.651727:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542017024 00000100:00100000:0.0:1787882780.651804:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542017024 00000100:00100000:0.0:1787882780.651956:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:0.0:1787882780.652103:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1874730542017024:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787882780.652211:0:14484:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 24be1cef-979a-4c79-bf95-de3d76f61b96@192.168.206.21@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:1.0:1787882780.652278:0:14484:0:(genops.c:1385:class_connect()) connect: client 24be1cef-979a-4c79-bf95-de3d76f61b96, cookie 0xf4731e8a7c5e0177 00000004:00100000:1.0:1787882780.652319:0:14484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787882780.652326:0:14484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787882780.684271:0:14484:0:(import.c:65:import_set_state_nolock()) ffff9fa29d879800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787882780.684519:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+6:2355:x1874730542017024:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 32549us (33110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882780.684534:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:2.0:1787882780.690670:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882780.690782:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882780.691318:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542017280 00000100:00100000:0.0:1787882780.691333:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542017280 00000100:00080000:2.0:1787882780.691530:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882780.691574:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542017152 00000100:00100000:1.0:1787882780.691580:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542017152 00000100:00100000:0.0:1787882780.691682:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:0.0:1787882780.691704:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+7:13791:x1874730542017280:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787882780.691764:0:15737:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787882780.693643:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:1.0:1787882780.693676:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+7:0:x1874730542017152:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787882780.693719:0:14482:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787882780.694134:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+7:0:x1874730542017152:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 474us (3349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882780.694145:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:1.0:1787882780.697651:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+6:13791:x1874730542017280:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 5940us (6985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882780.697667:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:3.0:1787882780.701083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882780.701207:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542017408 00000100:00100000:2.0:1787882780.701222:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542017408 00000100:00100000:2.0:1787882780.701324:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:2.0:1787882780.701337:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+6:13791:x1874730542017408:12345-192.168.206.21@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787882780.701449:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+6:13791:x1874730542017408:12345-192.168.206.21@tcp:40:mount.lustre.0 Request processed in 114us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882780.701458:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:2.0:1787882780.704011:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882780.704063:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882780.704165:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542017536 00000100:00100000:3.0:1787882780.704177:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542017536 00000100:00100000:3.0:1787882780.704227:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542017664 00000100:00100000:3.0:1787882780.704230:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542017664 00000100:00100000:3.0:1787882780.704246:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1787882780.704256:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874730542017536:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787882780.704297:0:15168:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 24be1cef-979a-4c79-bf95-de3d76f61b96@192.168.206.21@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:3.0:1787882780.704338:0:15168:0:(genops.c:1385:class_connect()) connect: client 24be1cef-979a-4c79-bf95-de3d76f61b96, cookie 0xf4731e8a7c5e017e 00002000:00100000:3.0:1787882780.704352:0:15168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 24be1cef-979a-4c79-bf95-de3d76f61b96/ffff9fa29d87e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787882780.704383:0:15168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787882780.704829:0:15168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787882780.704919:0:15168:0:(import.c:65:import_set_state_nolock()) ffff9fa29d87b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787882780.704999:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+6:2355:x1874730542017536:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 742us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882780.705008:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1787882780.705036:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:3.0:1787882780.705042:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1874730542017664:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787882780.705061:0:15168:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 24be1cef-979a-4c79-bf95-de3d76f61b96@192.168.206.21@tcp t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:3.0:1787882780.705092:0:15168:0:(genops.c:1385:class_connect()) connect: client 24be1cef-979a-4c79-bf95-de3d76f61b96, cookie 0xf4731e8a7c5e0185 00002000:00100000:3.0:1787882780.705099:0:15168:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 24be1cef-979a-4c79-bf95-de3d76f61b96/ffff9fa29d87a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787882780.705117:0:15168:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787882780.705255:0:15168:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787882780.705273:0:15168:0:(import.c:65:import_set_state_nolock()) ffff9fa2c1598800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787882780.705301:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+6:2355:x1874730542017664:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 257us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882780.705308:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:3.0:1787882780.706569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882780.706693:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542017792 00000100:00100000:2.0:1787882780.706705:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542017792 00000100:00100000:2.0:1787882780.706759:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:2.0:1787882780.706770:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+6:13791:x1874730542017792:12345-192.168.206.21@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787882780.710682:0:14485:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3820us 00000100:00100000:2.0:1787882780.712568:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882780.713098:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542017920 00000100:00100000:3.0:1787882780.713112:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542017920 00000100:00100000:3.0:1787882780.713184:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 89 00000100:00100000:3.0:1787882780.713197:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:2358:x1874730542017920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882780.713292:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:2358:x1874730542017920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 97us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882780.713302:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 89 00000004:00200000:2.0:1787882780.729444:0:14485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787882780.729688:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+6:13791:x1874730542017792:12345-192.168.206.21@tcp:33:mount.lustre.0 Request processed in 22910us (23119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882780.729703:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00010000:00010000:3.0:1787882780.842196:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787882780.954047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882780.954562:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542018048 00000100:00100000:3.0:1787882780.954592:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542018048 00000100:00100000:3.0:1787882780.954738:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1787882780.954753:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+6:13835:x1874730542018048:12345-192.168.206.21@tcp:101:mkdir.0 00010000:00010000:3.0:1787882780.954790:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882780.954826:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5e018c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84343d expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882780.954949:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5e0193 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882780.954966:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5e0193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882780.954988:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5e0193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882780.955420:0:14483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787882780.955425:0:14483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882780.955543:0:14483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5e0193 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882780.955578:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265c00/0xf4731e8a7c5e018c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84343d expref: 8 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882780.955606:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5e0193 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84343d expref: 7 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882780.955616:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30400) 00010000:00010000:3.0:1787882780.955619:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787882780.955624:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264600, rc 0) 00000100:00100000:3.0:1787882780.955717:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+7:13835:x1874730542018048:12345-192.168.206.21@tcp:101:mkdir.0 Request processed in 966us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882780.955726:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:1.0:1787882781.482790:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564028544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787882781.482913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882781.482986:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730564029056:0@lo:400:kworker.0 00000100:00100000:1.0:1787882781.483013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882781.483039:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787882781.483044:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564028928:0@lo:400:kworker.0 00000100:00100000:1.0:1787882781.483078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882781.483268:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564028544 00000100:00100000:3.0:1787882781.483279:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564028544 00000100:00100000:3.0:1787882781.483358:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787882781.483372:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730564028544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787882781.483400:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882781.483456:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730564028544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882781.483465:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787882781.483526:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564028544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882781.483555:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564028928 00000100:00100000:3.0:1787882781.483558:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564028928 00000100:00100000:3.0:1787882781.483584:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787882781.483591:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730564028928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882781.483790:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1874730564028928:12345-0@lo:400:kworker.0 Request processed in 199us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882781.483798:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787882781.483828:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564028928:0@lo:400:kworker.0 00000100:00100000:2.0:1787882781.484090:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564028672:0@lo:400:kworker.0 00000100:00100000:2.0:1787882781.484134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882781.484178:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730564029184:0@lo:400:kworker.0 00000100:00100000:2.0:1787882781.484205:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882781.484225:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787882781.484231:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564028800:0@lo:400:kworker.0 00000100:00100000:2.0:1787882781.484251:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882781.484289:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730564029312:0@lo:400:kworker.0 00000100:00100000:2.0:1787882781.484321:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882781.484362:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564028800 00000100:00100000:2.0:1787882781.484367:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564028800 00000100:00100000:2.0:1787882781.484403:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787882781.484410:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564028800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787882781.484449:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564028800:12345-0@lo:400:kworker.0 Request processed in 39us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882781.484456:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787882781.484486:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564028800:0@lo:400:kworker.0 00000100:00100000:2.0:1787882781.484506:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564029056 00000100:00100000:2.0:1787882781.484509:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564029056 00000100:00100000:2.0:1787882781.484534:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564029184 00000100:00100000:2.0:1787882781.484537:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564029184 00000100:00100000:2.0:1787882781.484550:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564029312 00000100:00100000:2.0:1787882781.484552:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564029312 00000100:00100000:2.0:1787882781.484569:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787882781.484576:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730564029056:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787882781.484706:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787882781.484712:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787882781.484714:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787882781.484728:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787882781.484737:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730564029184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882781.484796:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564028672 00000100:00100000:3.0:1787882781.484801:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564028672 00000100:00100000:3.0:1787882781.484832:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787882781.484838:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+19:3307:x1874730564028672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882781.485406:0:15737:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787882781.485418:0:15737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1787882781.485540:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787882781.485550:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730564029312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882781.489499:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874730564029184:12345-0@lo:400:kworker.0 Request processed in 4743us (5273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882781.489519:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787882781.489625:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874730564029184:0@lo:400:kworker.0 00000100:00100000:3.0:1787882781.493477:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+19:3307:x1874730564028672:12345-0@lo:400:kworker.0 Request processed in 8624us (9328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882781.493511:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787882781.493593:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564028672:0@lo:400:kworker.0 00000100:00100000:0.0:1787882781.501192:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730564029312:12345-0@lo:400:kworker.0 Request processed in 15628us (16853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882781.501212:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787882781.501291:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730564029312:0@lo:400:kworker.0 00000100:00100000:2.0:1787882781.510250:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730564029056:12345-0@lo:400:kworker.0 Request processed in 25201us (26762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882781.510270:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787882781.512709:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730564029056:0@lo:400:kworker.0 00000001:00100000:0.0:1787882781.590956:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787882781.591008:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 24be1cef-979a-4c79-bf95-de3d76f61b96 00000001:00080000:0.0:1787882781.591019:0:7664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1787882781.867145:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787882782.579992:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 24be1cef-979a-4c79-bf95-de3d76f61b96 00010000:00010000:3.0:1787882782.890720:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787882782.933420:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882782.938660:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542018176 00000100:00100000:2.0:1787882782.938681:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542018176 00000100:00100000:2.0:1787882782.938797:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:2.0:1787882782.938811:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+7:13887:x1874730542018176:12345-192.168.206.21@tcp:41:lfs.0 00000100:00080000:1.0:1787882782.939023:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1787882782.939120:0:14482:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787882782.939304:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+7:13887:x1874730542018176:12345-192.168.206.21@tcp:41:lfs.0 Request processed in 495us (5900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882782.939314:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:1.0:1787882782.951302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882782.951409:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542018304 00000100:00100000:3.0:1787882782.951423:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542018304 00000100:00100000:3.0:1787882782.951518:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:3.0:1787882782.951532:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:24be1cef-979a-4c79-bf95-de3d76f61b96+5:13887:x1874730542018304:12345-192.168.206.21@tcp:13:lfs.0 00002000:00000024:3.0:1787882782.951585:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882782.951713:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:24be1cef-979a-4c79-bf95-de3d76f61b96+5:13887:x1874730542018304:12345-192.168.206.21@tcp:13:lfs.0 Request processed in 183us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882782.951722:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00080000:1.0:1787882782.952003:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787882782.957545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882782.957651:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542018432 00000100:00100000:3.0:1787882782.957664:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542018432 00000100:00100000:3.0:1787882782.957748:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:3.0:1787882782.957760:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:24be1cef-979a-4c79-bf95-de3d76f61b96+5:13887:x1874730542018432:12345-192.168.206.21@tcp:13:lfs.0 00002000:00000024:3.0:1787882782.957808:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882782.958006:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:24be1cef-979a-4c79-bf95-de3d76f61b96+5:13887:x1874730542018432:12345-192.168.206.21@tcp:13:lfs.0 Request processed in 246us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882782.958015:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00080000:1.0:1787882782.958091:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787882783.018363:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564029440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882783.018457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882783.024941:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564029440 00000100:00100000:3.0:1787882783.024964:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564029440 00000100:00100000:3.0:1787882783.025092:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787882783.025108:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564029440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787882783.025143:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882783.025261:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564029440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (6803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882783.025288:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787882783.025366:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564029440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787882783.025483:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787882783.162665:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882783.169594:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542018560 00000100:00100000:2.0:1787882783.169616:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542018560 00000100:00100000:2.0:1787882783.169711:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 91 00000100:00100000:2.0:1787882783.169724:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+10:13918:x1874730542018560:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787882783.169746:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882783.169772:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2a791a600/0xf4731e8a7c5e019a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843444 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882783.169810:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2a791a600/0xf4731e8a7c5e019a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843444 expref: 11 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882783.169824:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2a791a600/0xf4731e8a7c5e019a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843444 expref: 11 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882783.169835:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a600, rc 0) 00000100:00100000:2.0:1787882783.169958:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:13918:x1874730542018560:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 235us (7320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882783.169966:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 91 00000100:00100000:0.0:1787882783.177247:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882783.178916:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542018688 00000100:00100000:3.0:1787882783.178937:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542018688 00000100:00100000:3.0:1787882783.179030:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 92 00000100:00100000:3.0:1787882783.179045:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:13918:x1874730542018688:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787882783.179484:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:13918:x1874730542018688:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 440us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882783.179494:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 92 00000100:00100000:3.0:1787882783.185133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882783.185216:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542018816 00000100:00100000:1.0:1787882783.185230:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542018816 00000100:00100000:1.0:1787882783.185300:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 93 00000100:00100000:1.0:1787882783.185313:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:13918:x1874730542018816:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787882783.186109:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:13918:x1874730542018816:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 792us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882783.186122:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 93 00000100:00100000:1.0:1787882783.223546:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882783.223712:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542018944 00000100:00100000:2.0:1787882783.223725:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542018944 00000100:00100000:2.0:1787882783.223796:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 94 00000100:00100000:2.0:1787882783.223819:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:13926:x1874730542018944:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787882783.224304:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:13926:x1874730542018944:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 484us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882783.224315:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 94 00000100:00100000:0.0:1787882783.259920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882783.261357:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542019072 00000100:00100000:1.0:1787882783.261376:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542019072 00000100:00100000:1.0:1787882783.261714:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00100000:1.0:1787882783.261728:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:13926:x1874730542019072:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787882783.262166:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5504450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:13926:x1874730542019072:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 439us (2259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882783.262177:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00100000:1.0:1787882783.271728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882783.272210:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542019200 00000100:00100000:3.0:1787882783.272225:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542019200 00000100:00100000:3.0:1787882783.272395:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:3.0:1787882783.272410:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:13918:x1874730542019200:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787882783.272606:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882783.272633:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b7265c00/0xf4731e8a7c5e01a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84346e expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882783.272673:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b7265c00/0xf4731e8a7c5e01a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84346e expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882783.272686:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b7265c00/0xf4731e8a7c5e01a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84346e expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882783.272699:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265c00, rc 0) 00000100:00100000:3.0:1787882783.272786:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5506050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+12:13918:x1874730542019200:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 379us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882783.272968:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:0.0:1787882783.279620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882783.279741:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542019328 00000100:00100000:1.0:1787882783.279754:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542019328 00000100:00100000:1.0:1787882783.279831:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00100000:1.0:1787882783.279903:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+12:13918:x1874730542019328:12345-192.168.206.21@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787882783.279938:0:14477:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787882783.279961:0:14477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787882783.279966:0:14477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787882783.279969:0:14477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787882783.279971:0:14477:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787882783.283390:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5504050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+12:13918:x1874730542019328:12345-192.168.206.21@tcp:256:mount.lustre.0 Request processed in 3504us (3768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882783.283408:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00100000:2.0:1787882783.287308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882783.287964:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542019456 00000100:00100000:3.0:1787882783.287978:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542019456 00000100:00100000:3.0:1787882783.288044:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 98 00000100:00100000:3.0:1787882783.288056:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+12:13918:x1874730542019456:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787882783.288088:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882783.288112:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5e01a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843475 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882783.288158:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5e01a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843475 expref: 13 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882783.288170:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5e01a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843475 expref: 13 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882783.288180:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265600, rc 0) 00000100:00100000:3.0:1787882783.288257:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5507050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13918:x1874730542019456:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 203us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882783.288265:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 98 00000100:00100000:0.0:1787882783.293772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882783.294409:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542019584 00000100:00100000:1.0:1787882783.294429:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542019584 00000100:00100000:1.0:1787882783.294546:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 99 00000100:00100000:1.0:1787882783.294559:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13918:x1874730542019584:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787882783.295334:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5506850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13918:x1874730542019584:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 772us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882783.295346:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 99 00000100:00100000:0.0:1787882783.297594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882783.297688:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542019712 00000100:00100000:3.0:1787882783.297700:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542019712 00000100:00100000:3.0:1787882783.297794:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 100 00000100:00100000:3.0:1787882783.297807:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13918:x1874730542019712:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787882783.298158:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5505450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13918:x1874730542019712:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 346us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882783.298168:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 100 00000100:00100000:2.0:1787882783.301736:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882783.301905:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542019840 00000100:00100000:1.0:1787882783.301918:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542019840 00000100:00100000:1.0:1787882783.301988:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 101 00000100:00100000:1.0:1787882783.302001:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13931:x1874730542019840:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787882783.302595:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5505850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13931:x1874730542019840:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 592us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882783.302606:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 101 00000100:00100000:1.0:1787882783.313036:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882783.313254:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542019968 00000100:00100000:3.0:1787882783.313268:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542019968 00000100:00100000:3.0:1787882783.313330:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 102 00000100:00100000:3.0:1787882783.313342:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13931:x1874730542019968:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787882783.313679:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5504850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13931:x1874730542019968:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 338us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882783.313693:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 102 00000100:00100000:2.0:1787882783.332303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882783.332586:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542020096 00000100:00100000:1.0:1787882783.332601:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542020096 00000100:00100000:1.0:1787882783.332696:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:1.0:1787882783.332710:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1874730542020096:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787882783.332753:0:14483:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0011688e-6324-4e6f-a6c4-bb79489cb0d9@192.168.206.21@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:1.0:1787882783.332804:0:14483:0:(genops.c:1385:class_connect()) connect: client 0011688e-6324-4e6f-a6c4-bb79489cb0d9, cookie 0xf4731e8a7c5e01af 00000004:00100000:1.0:1787882783.332846:0:14483:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787882783.333361:0:14483:0:(import.c:65:import_set_state_nolock()) ffff9fa2982b7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787882783.333624:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:2355:x1874730542020096:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 913us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882783.333635:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:2.0:1787882783.347372:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882783.347678:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882783.347757:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542020224 00000100:00100000:1.0:1787882783.347771:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542020224 00000100:00100000:1.0:1787882783.347910:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542020352 00000100:00100000:1.0:1787882783.347914:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542020352 00000100:00100000:1.0:1787882783.347947:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:1.0:1787882783.347958:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0011688e-6324-4e6f-a6c4-bb79489cb0d9+7:0:x1874730542020224:12345-192.168.206.21@tcp:41:mount.lustre.0 00000100:00080000:2.0:1787882783.348017:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787882783.348038:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:2.0:1787882783.348048:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+7:13918:x1874730542020352:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787882783.348085:0:16359:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:2.0:1787882783.348086:0:14482:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787882783.348259:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0011688e-6324-4e6f-a6c4-bb79489cb0d9+7:0:x1874730542020224:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 301us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882783.348268:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:2.0:1787882783.349482:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:13918:x1874730542020352:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 1427us (1797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882783.349494:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:0.0:1787882783.353485:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882783.353629:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542020480 00000100:00100000:1.0:1787882783.353641:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542020480 00000100:00100000:1.0:1787882783.353766:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:1.0:1787882783.353780:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:13918:x1874730542020480:12345-192.168.206.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787882783.353929:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:13918:x1874730542020480:12345-192.168.206.21@tcp:40:mount.lustre.0 Request processed in 152us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882783.353939:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:0.0:1787882783.357093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882783.357144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882783.357541:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542020864 00000100:00100000:2.0:1787882783.357555:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542020864 00000100:00100000:2.0:1787882783.357618:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:2.0:1787882783.357631:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:13918:x1874730542020864:12345-192.168.206.21@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787882783.357976:0:14486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787882783.358468:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882783.358516:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:13918:x1874730542020864:12345-192.168.206.21@tcp:33:mount.lustre.0 Request processed in 886us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882783.358527:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:3.0:1787882783.375650:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542020608 00000100:00100000:3.0:1787882783.375673:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542020608 00000100:00100000:2.0:1787882783.375801:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542020736 00000100:00100000:2.0:1787882783.375807:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542020736 00000100:00100000:2.0:1787882783.376113:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:2.0:1787882783.376124:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874730542020736:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787882783.376170:0:15167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0011688e-6324-4e6f-a6c4-bb79489cb0d9@192.168.206.21@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:2.0:1787882783.376206:0:15167:0:(genops.c:1385:class_connect()) connect: client 0011688e-6324-4e6f-a6c4-bb79489cb0d9, cookie 0xf4731e8a7c5e01b6 00002000:00100000:2.0:1787882783.376219:0:15167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0011688e-6324-4e6f-a6c4-bb79489cb0d9/ffff9fa29038b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787882783.376232:0:15167:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787882783.376535:0:15167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787882783.376575:0:15167:0:(import.c:65:import_set_state_nolock()) ffff9fa29038a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787882783.376668:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:2355:x1874730542020736:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 543us (18201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882783.376677:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:2.0:1787882783.376695:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:2.0:1787882783.376700:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1874730542020608:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787882783.376714:0:15167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0011688e-6324-4e6f-a6c4-bb79489cb0d9@192.168.206.21@tcp t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:2.0:1787882783.376733:0:15167:0:(genops.c:1385:class_connect()) connect: client 0011688e-6324-4e6f-a6c4-bb79489cb0d9, cookie 0xf4731e8a7c5e01bd 00002000:00100000:2.0:1787882783.376738:0:15167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0011688e-6324-4e6f-a6c4-bb79489cb0d9/ffff9fa29038c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787882783.376744:0:15167:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787882783.376863:0:15167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787882783.376907:0:15167:0:(import.c:65:import_set_state_nolock()) ffff9fa282bb6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787882783.376930:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:2355:x1874730542020608:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 228us (19785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882783.376936:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1787882783.521011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882783.521197:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542020992 00000100:00100000:1.0:1787882783.521212:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542020992 00000100:00100000:1.0:1787882783.521293:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:1.0:1787882783.521306:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:13952:x1874730542020992:12345-192.168.206.21@tcp:101:mkdir.0 00010000:00010000:1.0:1787882783.521334:0:15737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882783.521376:0:15737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e01c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84349f expref: -99 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882783.521471:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882783.521488:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882783.521499:0:15737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882783.521771:0:15737:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787882783.521776:0:15737:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787882783.521864:0:15737:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882783.521952:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e01c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84349f expref: 8 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882783.521972:0:15737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84349f expref: 7 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882783.521982:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30400) 00010000:00010000:1.0:1787882783.521986:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787882783.521999:0:15737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6a00, rc 0) 00000100:00100000:1.0:1787882783.522090:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0011688e-6324-4e6f-a6c4-bb79489cb0d9+7:13952:x1874730542020992:12345-192.168.206.21@tcp:101:mkdir.0 Request processed in 786us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882783.522099:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00010000:00010000:1.0:1787882783.917266:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787882784.428606:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787882784.938173:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787882785.967596:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787882786.168270:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0011688e-6324-4e6f-a6c4-bb79489cb0d9 00000001:00100000:0.0:1787882786.168316:0:5873:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 24be1cef-979a-4c79-bf95-de3d76f61b96 00000001:02000400:1.0:1787882786.559152:0:16448:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787882786.607203:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfcc18db-0526-4071-939f-14c6713c8186:3306:1874730564029568:0@lo:400:kworker.0 00000100:00100000:3.0:1787882786.607293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882786.607351:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730564030080:0@lo:400:kworker.0 00000100:00100000:3.0:1787882786.607388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882786.607415:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787882786.607420:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730564029952:0@lo:400:kworker.0 00000100:00100000:3.0:1787882786.607440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882786.610528:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564029696:0@lo:400:kworker.0 00000100:00100000:3.0:1787882786.610630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882786.610679:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730564030208:0@lo:400:kworker.0 00000100:00100000:3.0:1787882786.610713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882786.610747:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787882786.610755:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564029824:0@lo:400:kworker.0 00000100:00100000:3.0:1787882786.610777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882786.610796:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564030336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882786.610838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882786.610905:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564029568 00000100:00100000:3.0:1787882786.610915:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564029568 00000100:00100000:3.0:1787882786.610969:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787882786.610980:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+19:3306:x1874730564029568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882786.611055:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5506450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+19:3306:x1874730564029568:12345-0@lo:400:kworker.0 Request processed in 76us (3760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882786.611062:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787882786.611103:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564030080 00000100:00100000:3.0:1787882786.611107:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564030080 00000100:00100000:3.0:1787882786.611144:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564029952 00000100:00100000:3.0:1787882786.611148:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564029952 00000100:00100000:3.0:1787882786.611167:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564030208 00000100:00100000:3.0:1787882786.611170:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564030208 00000100:00100000:3.0:1787882786.611186:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787882786.611193:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730564030080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882786.611229:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874730564030080:12345-0@lo:400:kworker.0 Request processed in 37us (3839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882786.611235:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787882786.611247:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787882786.611253:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730564029952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882786.611281:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874730564029952:12345-0@lo:400:kworker.0 Request processed in 29us (3841us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882786.611286:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787882786.611296:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787882786.611924:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564029696 00000100:00100000:1.0:1787882786.611932:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564029696 00000100:00100000:1.0:1787882786.612454:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564029824 00000100:00100000:1.0:1787882786.612460:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564029824 00000100:00100000:0.0:1787882786.612460:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787882786.612471:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564029696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882786.612482:0:15166:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787882786.612490:0:15166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787882786.612547:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564029696:12345-0@lo:400:kworker.0 Request processed in 77us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882786.612554:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787882786.612570:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787882786.612576:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564029824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882786.612604:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564029824:12345-0@lo:400:kworker.0 Request processed in 29us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882786.612610:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787882786.612650:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787882786.612672:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564029824:0@lo:400:kworker.0 00000100:00100000:0.0:1787882786.612685:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564029696:0@lo:400:kworker.0 00000100:00100000:3.0:1787882786.615415:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730564030208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882786.615551:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874730564030208:12345-0@lo:400:kworker.0 Request processed in 4244us (4831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882786.615575:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787882786.615641:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564030336 00000100:00100000:3.0:1787882786.615651:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564030336 00000100:00100000:3.0:1787882786.615798:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787882786.615808:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564030336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787882786.615837:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787882786.615899:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564030336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (5060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882786.615906:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787882786.616030:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787882786.616038:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787882786.616051:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882786.616098:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874730564029952:0@lo:400:kworker.0 00000100:00100000:1.0:1787882786.616111:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfcc18db-0526-4071-939f-14c6713c8186:3306:1874730564029568:0@lo:400:kworker.0 00000100:00100000:1.0:1787882786.616123:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874730564030080:0@lo:400:kworker.0 00000100:00100000:0.0:1787882786.616310:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564030336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787882786.616325:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874730564030208:0@lo:400:kworker.0 00000001:00100000:2.0:1787882786.708490:0:7664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0011688e-6324-4e6f-a6c4-bb79489cb0d9 00010000:00010000:3.0:1787882786.987202:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787882787.708798:0:6737:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0011688e-6324-4e6f-a6c4-bb79489cb0d9 00010000:00010000:1.0:1787882788.014162:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882788.138470:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564030464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882788.138569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882788.138801:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564030464 00000100:00100000:2.0:1787882788.138812:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564030464 00000100:00080000:3.0:1787882788.139257:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882788.139535:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787882788.139550:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564030464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787882788.139598:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787882788.139751:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564030464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882788.139760:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787882788.140296:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564030464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787882788.517308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882788.517363:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882788.517395:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882788.517436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882788.517464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882788.517482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882788.517510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882788.517537:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542021504 00000100:00100000:3.0:1787882788.517541:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542021120 00000100:00100000:3.0:1787882788.517553:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542021120 00000100:00100000:1.0:1787882788.517553:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542021504 00000100:00100000:1.0:1787882788.517624:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542021760 00000100:00100000:3.0:1787882788.517628:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00100000:1.0:1787882788.517630:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542021760 00000100:00100000:3.0:1787882788.517646:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:2359:x1874730542021120:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882788.517654:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542021376 00000100:00100000:1.0:1787882788.517658:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542021376 00000100:00100000:1.0:1787882788.517672:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542021888 00000100:00100000:1.0:1787882788.517675:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542021888 00000100:00100000:1.0:1787882788.517691:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:1.0:1787882788.517699:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2359:x1874730542021504:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882788.517812:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2359:x1874730542021504:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 114us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882788.517822:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:1.0:1787882788.517843:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:1.0:1787882788.517849:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2359:x1874730542021760:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882788.517903:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2359:x1874730542021760:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 54us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882788.517909:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:1.0:1787882788.517922:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:1.0:1787882788.517928:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2359:x1874730542021376:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882788.517953:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2359:x1874730542021376:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882788.517959:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:1.0:1787882788.517972:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:1.0:1787882788.517978:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2359:x1874730542021888:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882788.518004:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2359:x1874730542021888:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882788.518010:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:0.0:1787882788.518391:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542021248 00000100:00100000:0.0:1787882788.518398:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542021248 00000100:00100000:0.0:1787882788.518443:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542021632 00000100:00100000:0.0:1787882788.518446:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542021632 00000100:00100000:0.0:1787882788.518472:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:0.0:1787882788.518488:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+6:2359:x1874730542021248:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882788.518532:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+6:2359:x1874730542021248:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 45us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882788.518539:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:0.0:1787882788.518553:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:0.0:1787882788.518961:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:2359:x1874730542021632:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882788.519000:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:2359:x1874730542021632:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 440us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882788.519007:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00080000:0.0:1787882788.519056:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787882788.519062:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787882788.519065:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787882788.521579:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5507450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:2359:x1874730542021120:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3921us (4124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882788.521597:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 104 00010000:00010000:3.0:1787882789.034154:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787882790.058286:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787882790.248837:0:16597:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd21e5a1a0 20000000:00000080:1.0:1787882790.248852:0:16597:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fa2b7fd1c00 uarg=0000000000000000 20000000:01000000:1.0:1787882790.249062:0:16597:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787882790.249068:0:16597:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787882790.249072:0:16597:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787882790.250482:0:16598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787882790.250635:0:16597:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787882790.257319:0:16597:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787882790.258017:0:16597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258047:0:16597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfec9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dfec2 expref: 18 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258056:0:16597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2a791a400/0xf4731e8a7c5dff16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5dff0f expref: 18 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258063:0:16597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa289fa6400/0xf4731e8a7c5e0051 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5e004a expref: 18 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258071:0:16597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2a791a000/0xf4731e8a7c5e0170 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843413 expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258077:0:16597:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5e01a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843475 expref: 12 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258100:0:16597:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258142:0:16597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5e01a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843475 expref: 12 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258157:0:16597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5e01a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843475 expref: 12 pid: 14475 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882790.258172:0:16597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1874730564030592:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882790.258286:0:16597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2a791a000/0xf4731e8a7c5e0170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843413 expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258295:0:16597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2a791a000/0xf4731e8a7c5e0170 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843413 expref: 12 pid: 14476 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882790.258303:0:16597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1874730564030720:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882790.258339:0:16597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa289fa6400/0xf4731e8a7c5e0051 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5e004a expref: 18 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258348:0:16597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa289fa6400/0xf4731e8a7c5e0051 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5e004a expref: 18 pid: 14476 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882790.258357:0:16597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1874730564030848:0@lo:104: 00000100:00100000:0.0:1787882790.258774:0:16597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787882790.258815:0:16597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2a791a400/0xf4731e8a7c5dff16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dff0f expref: 18 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258836:0:16597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2a791a400/0xf4731e8a7c5dff16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dff0f expref: 18 pid: 14475 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882790.258845:0:16597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1874730564030976:0@lo:104: 00000100:00100000:0.0:1787882790.258892:0:16597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787882790.258918:0:16597:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfec9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4731e8a7c5dfec2 expref: 18 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.258926:0:16597:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfec9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfec2 expref: 18 pid: 14477 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882790.258934:0:16597:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1874730564031104:0@lo:104: 00000100:00100000:0.0:1787882790.258956:0:16597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882790.258964:0:16597:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787882790.259038:0:14466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787882790.259052:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564030848 00000100:00100000:1.0:1787882790.259053:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564030976 00000100:00100000:2.0:1787882790.259058:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564030848 00000100:00100000:1.0:1787882790.259059:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564030976 00000100:00100000:2.0:1787882790.259100:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564031104 00000100:00100000:2.0:1787882790.259104:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564031104 00000100:00100000:1.0:1787882790.259440:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787882790.259451:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+5:16597:x1874730564030848:12345-0@lo:104: 00010000:00010000:1.0:1787882790.259465:0:14465:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882790.259562:0:14465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787882790.259569:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+5:16597:x1874730564030848:12345-0@lo:104: Request processed in 121us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882790.259576:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787882790.259593:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787882790.259599:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+4:16597:x1874730564030976:12345-0@lo:104: 00010000:00010000:1.0:1787882790.259606:0:14465:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882790.259647:0:14465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787882790.259653:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+4:16597:x1874730564030976:12345-0@lo:104: Request processed in 54us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882790.259659:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787882790.259672:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787882790.259678:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf45a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+3:16597:x1874730564031104:12345-0@lo:104: 00010000:00010000:1.0:1787882790.259684:0:14465:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882790.259710:0:14465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787882790.259723:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf45a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bfcc18db-0526-4071-939f-14c6713c8186+3:16597:x1874730564031104:12345-0@lo:104: Request processed in 45us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882790.259728:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787882790.259838:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787882790.259844:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.259852:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882790.259856:0:14471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.259865:0:14471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882790.259896:0:14471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882790.259901:0:14471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787882790.259927:0:14471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.259933:0:14471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882790.259952:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.259959:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7800/0xf4731e8a7c5e004a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5e0051 expref: -99 pid: 15884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.259970:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787882790.259973:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.259978:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7e00 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882790.259986:0:14471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.259993:0:14471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882790.260000:0:14471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882790.260005:0:14471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787882790.260015:0:14471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260041:0:14471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882790.260056:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260062:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7e00/0xf4731e8a7c5dff0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dff16 expref: -99 pid: 15164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260071:0:14471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787882790.260074:0:14471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260080:0:14471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa280030800 already unused, calling callback (ffffffffc1bb9c20) 10000000:00010000:3.0:1787882790.260083:0:14471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260089:0:14471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787882790.260104:0:14471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787882790.260110:0:14471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787882790.260122:0:14471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260127:0:14471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787882790.260132:0:14471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260138:0:14471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fa280030800/0xf4731e8a7c5dfec2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4731e8a7c5dfec9 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260151:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882790.260153:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882790.260155:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882790.260167:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfcc18db-0526-4071-939f-14c6713c8186:3306:1874730564031232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882790.260197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882790.260237:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564031360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882790.260255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882790.260267:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787882790.260271:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564031488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882790.260288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882790.260306:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564031232 00000100:00100000:3.0:1787882790.260311:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564031232 00010000:00010000:3.0:1787882790.260331:0:14467:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa289fa6400/0xf4731e8a7c5e0051 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5e004a expref: 19 pid: 14476 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882790.260354:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564031360 00000100:00100000:3.0:1787882790.260357:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564031360 00010000:00010000:3.0:1787882790.260366:0:14467:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2a791a400/0xf4731e8a7c5dff16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dff0f expref: 20 pid: 14475 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882790.260374:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564031488 00000100:00100000:3.0:1787882790.260376:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564031488 00010000:00010000:3.0:1787882790.260383:0:14467:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfec9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfec2 expref: 21 pid: 14477 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882790.260392:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787882790.260397:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfcc18db-0526-4071-939f-14c6713c8186+21:3306:x1874730564031232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882790.260407:0:14467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882790.260411:0:14467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa289fa6400/0xf4731e8a7c5e0051 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5e004a expref: 21 pid: 14476 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260490:0:14467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa289fa6400/0xf4731e8a7c5e0051 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5e004a expref: 21 pid: 14476 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260507:0:14467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882790.260533:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfcc18db-0526-4071-939f-14c6713c8186+21:3306:x1874730564031232:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882790.260540:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787882790.260553:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787882790.260559:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfcc18db-0526-4071-939f-14c6713c8186+20:3307:x1874730564031360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882790.260566:0:14467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882790.260570:0:14467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2a791a400/0xf4731e8a7c5dff16 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dff0f expref: 20 pid: 14475 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260590:0:14467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2a791a400/0xf4731e8a7c5dff16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dff0f expref: 20 pid: 14475 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260599:0:14467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882790.260625:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfcc18db-0526-4071-939f-14c6713c8186+20:3307:x1874730564031360:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882790.260631:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787882790.260643:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787882790.260651:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5552050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfcc18db-0526-4071-939f-14c6713c8186+19:3307:x1874730564031488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787882790.260659:0:14467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882790.260663:0:14467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfec9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfec2 expref: 19 pid: 14477 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260671:0:14467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfec9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4731e8a7c5dfec2 expref: 19 pid: 14477 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882790.260681:0:14467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882790.260701:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5552050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfcc18db-0526-4071-939f-14c6713c8186+19:3307:x1874730564031488:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882790.260707:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787882790.260761:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564031488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882790.260769:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564031360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787882790.260793:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bfcc18db-0526-4071-939f-14c6713c8186:3306:1874730564031232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787882790.260863:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882790.261167:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa289fa6400/0xf4731e8a7c5e0051 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5e004a expref: 18 pid: 14476 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882790.261180:0:16597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1874730564030848:0@lo:104: 00010000:00010000:0.0:1787882790.261190:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2a791a400/0xf4731e8a7c5dff16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dff0f expref: 17 pid: 14475 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882790.261196:0:16597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1874730564030976:0@lo:104: 00010000:00010000:0.0:1787882790.261205:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2a791b600/0xf4731e8a7c5dfec9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4731e8a7c5dfec2 expref: 16 pid: 14477 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882790.261212:0:16597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1874730564031104:0@lo:104: 00000100:00100000:0.0:1787882790.261222:0:16597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9877b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1874730564030592:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882790.263034:0:16597:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16597:1874730564030720:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882790.263072:0:16597:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882790.265687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882790.265727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882790.266340:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542022144 00000100:00100000:0.0:1787882790.266350:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542022144 00010000:00010000:0.0:1787882790.266389:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2a791a000/0xf4731e8a7c5e0170 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843413 expref: 13 pid: 14476 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882790.266466:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542022016 00000100:00100000:0.0:1787882790.266470:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542022016 00010000:00010000:0.0:1787882790.266484:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5e01a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843475 expref: 14 pid: 14475 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882790.266499:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1787882790.266507:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d82aa22-d25e-44d7-9348-ff42d56742a8+14:2356:x1874730542022144:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882790.266519:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882790.266524:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2a791a000/0xf4731e8a7c5e0170 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843413 expref: 14 pid: 14476 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266534:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2a791a000/0xf4731e8a7c5e0170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843413 expref: 14 pid: 14476 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266551:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2a791a000/0xf4731e8a7c5e0170 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843413 expref: 14 pid: 14476 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266565:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882790.266612:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:2356:x1874730542022144:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 105us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882790.266619:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1787882790.266633:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1787882790.266640:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d82aa22-d25e-44d7-9348-ff42d56742a8+12:2356:x1874730542022016:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882790.266662:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882790.266667:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5e01a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843475 expref: 12 pid: 14475 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266677:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5e01a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843475 expref: 12 pid: 14475 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266687:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b7265600/0xf4731e8a7c5e01a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843475 expref: 12 pid: 14475 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266698:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266705:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266719:0:14469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266727:0:14469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266733:0:14469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266740:0:14469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266746:0:14469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448c00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882790.266750:0:14469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266768:0:14469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266780:0:14469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882790.266790:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882790.266810:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:2356:x1874730542022016:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 170us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882790.266817:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00010000:00010000:1.0:1787882790.267008:0:16597:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882790.267017:0:16597:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882790.267033:0:16597:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fa2b6448c00/0xf4731e8a7c5e01d2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882791.083910:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882791.723415:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfcc18db-0526-4071-939f-14c6713c8186:3305:1874730564031616:0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.723503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882791.723554:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564032128:0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.723578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882791.723604:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787882791.723610:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564031744:0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.723634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882791.723652:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730564032256:0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.723674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882791.723702:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564031872:0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.723723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882791.723742:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787882791.723748:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730564032000:0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.723770:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882791.723822:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564032128 00000100:00100000:3.0:1787882791.723831:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564032128 00000100:00100000:3.0:1787882791.724236:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564032256 00000100:00100000:3.0:1787882791.724241:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564032256 00000100:00100000:3.0:1787882791.724267:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564032000 00000100:00100000:3.0:1787882791.724270:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564032000 00000100:00100000:3.0:1787882791.724286:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787882791.724295:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564032128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.724351:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564032128:12345-0@lo:400:kworker.0 Request processed in 57us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882791.724358:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787882791.724375:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787882791.724380:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730564032256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.724417:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730564032256:12345-0@lo:400:kworker.0 Request processed in 37us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882791.724423:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787882791.724433:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787882791.724438:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730564032000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.724465:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730564032000:12345-0@lo:400:kworker.0 Request processed in 27us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882791.724470:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787882791.724489:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564031744 00000100:00100000:3.0:1787882791.724492:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564031744 00000100:00100000:3.0:1787882791.724514:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564031872 00000100:00100000:3.0:1787882791.724517:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564031872 00000100:00100000:3.0:1787882791.724536:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787882791.724542:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564031744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.724571:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874730564031744:12345-0@lo:400:kworker.0 Request processed in 30us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882791.724577:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787882791.724587:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787882791.724592:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564031872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.724619:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564031872:12345-0@lo:400:kworker.0 Request processed in 27us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882791.724624:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787882791.724651:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787882791.724655:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787882791.724657:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882791.724697:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730564032000:0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.724719:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564031872:0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.724751:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874730564031744:0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.724761:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730564032256:0@lo:400:kworker.0 00000100:00100000:3.0:1787882791.724769:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564032128:0@lo:400:kworker.0 00000100:00100000:1.0:1787882791.725128:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564031616 00000100:00100000:1.0:1787882791.725134:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564031616 00000100:00100000:1.0:1787882791.725172:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787882791.725179:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+16:3305:x1874730564031616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787882791.725218:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5505c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+16:3305:x1874730564031616:12345-0@lo:400:kworker.0 Request processed in 39us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882791.725224:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787882791.725301:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bfcc18db-0526-4071-939f-14c6713c8186:3305:1874730564031616:0@lo:400:kworker.0 00000100:00100000:2.0:1787882791.725921:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787882791.725936:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564032384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787882791.725989:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882791.726035:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564032384 00000100:00100000:2.0:1787882791.726039:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564032384 00000100:00100000:2.0:1787882791.726070:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787882791.726077:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730564032384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787882791.726100:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787882791.726137:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874730564032384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882791.726144:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787882791.726191:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874730564032384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787882791.851830:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882791.852002:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542022272 00000100:00100000:3.0:1787882791.852024:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542022272 00000100:00100000:3.0:1787882791.852073:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 106 00000100:00100000:3.0:1787882791.852083:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+11:13805:x1874730542022272:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787882791.852097:0:14476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882791.852117:0:14476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b7265800/0xf4731e8a7c5e01d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434a6 expref: -99 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882791.852148:0:14476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b7265800/0xf4731e8a7c5e01d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434a6 expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882791.852159:0:14476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b7265800/0xf4731e8a7c5e01d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434a6 expref: 12 pid: 14476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882791.852169:0:14476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265800, rc 0) 00000100:00100000:3.0:1787882791.852229:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5504c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+12:13805:x1874730542022272:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 148us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882791.852236:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 106 00000100:00100000:1.0:1787882791.861825:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882791.862917:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542022400 00000100:00100000:0.0:1787882791.862928:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542022400 00000100:00100000:0.0:1787882791.862974:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 107 00000100:00100000:0.0:1787882791.862983:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+12:13805:x1874730542022400:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882791.863546:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5507c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+12:13805:x1874730542022400:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 563us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882791.863555:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 107 00000100:00100000:0.0:1787882791.867197:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882791.867265:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542022528 00000100:00100000:1.0:1787882791.867274:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542022528 00000100:00100000:1.0:1787882791.867324:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 108 00000100:00100000:1.0:1787882791.867334:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+12:13805:x1874730542022528:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882791.867557:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5506c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+12:13805:x1874730542022528:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 224us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882791.867572:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 108 00000100:00100000:1.0:1787882791.884678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882791.884758:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542022656 00000100:00100000:0.0:1787882791.884770:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542022656 00000100:00100000:0.0:1787882791.884821:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 109 00000100:00100000:0.0:1787882791.884832:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+12:13805:x1874730542022656:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882791.884848:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882791.884865:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b6448400/0xf4731e8a7c5e01e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434ad expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882791.884937:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b6448400/0xf4731e8a7c5e01e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434ad expref: 13 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882791.884958:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b6448400/0xf4731e8a7c5e01e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434ad expref: 13 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882791.884967:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b6448400, rc 0) 00000100:00100000:0.0:1787882791.885033:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5505050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13805:x1874730542022656:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 202us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882791.885040:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 109 00000100:00100000:0.0:1787882791.887361:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882791.887440:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542022784 00000100:00100000:3.0:1787882791.887454:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542022784 00000100:00100000:3.0:1787882791.887504:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 110 00000100:00100000:3.0:1787882791.887514:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13805:x1874730542022784:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787882791.887776:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5507850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13805:x1874730542022784:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 262us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882791.887784:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 110 00000100:00100000:3.0:1787882791.890731:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882791.891082:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542022912 00000100:00100000:1.0:1787882791.891092:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542022912 00000100:00100000:1.0:1787882791.891150:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 111 00000100:00100000:1.0:1787882791.891161:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13805:x1874730542022912:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882791.891392:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:13805:x1874730542022912:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 232us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882791.891399:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 111 00010000:00010000:2.0:1787882792.106082:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787882792.173327:0:14479:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787882792.173333:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2a05d0000 from 10 10000000:01000000:1.0:1787882792.173339:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787882792.173393:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6800/0xf4731e8a7c5e01e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882792.173405:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6800/0xf4731e8a7c5e01e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882792.173416:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6800/0xf4731e8a7c5e01e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882792.173441:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564032512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787882792.173504:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882792.173555:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787882792.173977:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564032512 00000100:00100000:0.0:1787882792.173985:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564032512 00000100:00100000:0.0:1787882792.174050:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787882792.174061:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+16:14479:x1874730564032512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882792.174074:0:14477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882792.174088:0:14477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b6448a00/0xf4731e8a7c5e01ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5e01e7 expref: -99 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882792.174113:0:14477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b6448a00/0xf4731e8a7c5e01ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5e01e7 expref: 17 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882792.174125:0:14477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b6448a00/0xf4731e8a7c5e01ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5e01e7 expref: 17 pid: 14477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882792.174133:0:14477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b6448a00, rc 0) 00000100:00100000:0.0:1787882792.174185:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+17:14479:x1874730564032512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882792.174200:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787882792.174267:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564032512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882792.174283:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6800/0xf4731e8a7c5e01e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e01ee expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882792.174294:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6800/0xf4731e8a7c5e01e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5e01ee expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882792.174353:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564032640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882792.174381:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882792.174405:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787882792.175276:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564032640 00000100:00100000:1.0:1787882792.175284:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564032640 00000100:00100000:1.0:1787882792.175340:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787882792.175348:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+17:14479:x1874730564032640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882792.176303:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+17:14479:x1874730564032640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 805us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882792.176437:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787882792.177542:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564032640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882792.177596:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564032768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787882792.177661:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787882792.177710:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564032768 00000100:00100000:0.0:1787882792.177714:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf74f780 going to sleep for 11 seconds 00000100:00100000:3.0:1787882792.177719:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564032768 00000100:00100000:3.0:1787882792.177768:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787882792.177778:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+17:14479:x1874730564032768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787882792.178115:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+17:14479:x1874730564032768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 338us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882792.178123:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787882792.179325:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564032768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787882792.183714:0:16684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787882792.183890:0:14479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787882792.183910:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787882792.183921:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6800/0xf4731e8a7c5e01e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e01ee expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882792.183933:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa289fa6800/0xf4731e8a7c5e01e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e01ee expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787882792.183943:0:14479:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787882792.183945:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa288a01000 from 10 10000000:01000000:1.0:1787882792.183947:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787882792.183980:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7600/0xf4731e8a7c5e01f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882792.183988:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7600/0xf4731e8a7c5e01f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882792.183998:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7600/0xf4731e8a7c5e01f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882792.184030:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564032896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787882792.184087:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882792.184128:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749300 going to sleep for 11 seconds 00000100:00100000:0.0:1787882792.187628:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564032896 00000100:00100000:0.0:1787882792.187644:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564032896 00000100:00100000:0.0:1787882792.187714:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787882792.187727:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+17:14479:x1874730564032896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787882792.187744:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882792.187765:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa2b6448e00/0xf4731e8a7c5e01fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5e01f5 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882792.187809:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa2b6448e00/0xf4731e8a7c5e01fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5e01f5 expref: 18 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882792.187821:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa2b6448e00/0xf4731e8a7c5e01fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5e01f5 expref: 18 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882792.187830:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b6448e00, rc 0) 00000100:00100000:0.0:1787882792.187951:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+18:14479:x1874730564032896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (3863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882792.187968:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787882792.189448:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564032896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787882792.189477:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7600/0xf4731e8a7c5e01f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e01fc expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882792.189490:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7600/0xf4731e8a7c5e01f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5e01fc expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882792.189581:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564033024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882792.189657:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882792.189701:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29daf0900 going to sleep for 11 seconds 00000100:00100000:0.0:1787882792.190271:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564033024 00000100:00100000:0.0:1787882792.190279:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564033024 00000100:00100000:0.0:1787882792.190334:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787882792.190343:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+18:14479:x1874730564033024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787882792.190745:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+18:14479:x1874730564033024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882792.190754:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787882792.190804:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564033024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787882792.190845:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564033152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787882792.190915:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882792.190949:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29daf0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787882792.190999:0:14476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564033152 00000100:00100000:1.0:1787882792.191006:0:14476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564033152 00000100:00100000:1.0:1787882792.201118:0:14476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787882792.201141:0:14476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+18:14479:x1874730564033152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882792.202579:0:14476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfcc18db-0526-4071-939f-14c6713c8186+18:14479:x1874730564033152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1439us (11654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882792.202593:0:14476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787882792.202721:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564033152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787882792.210059:0:16686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787882792.211513:0:14479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787882792.211550:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787882792.211562:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7600/0xf4731e8a7c5e01f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e01fc expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882792.211575:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa289fa7600/0xf4731e8a7c5e01f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e01fc expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787882792.211587:0:14479:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787882792.211590:0:14479:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fa2bfbc0000 from 10 10000000:01000000:2.0:1787882792.211593:0:14479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787882792.211644:0:14479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ba00/0xf4731e8a7c5e0203 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882792.211653:0:14479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ba00/0xf4731e8a7c5e0203 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882792.211663:0:14479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ba00/0xf4731e8a7c5e0203 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882792.211686:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564033280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787882792.211753:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882792.211804:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29daf0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787882792.212602:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564033280 00000100:00100000:1.0:1787882792.212612:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564033280 00000100:00100000:1.0:1787882792.212669:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787882792.212679:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+18:14479:x1874730564033280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882792.212693:0:14475:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882792.212708:0:14475:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fa289fa6200/0xf4731e8a7c5e020a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4731e8a7c5e0203 expref: -99 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882792.212734:0:14475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fa289fa6200/0xf4731e8a7c5e020a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4731e8a7c5e0203 expref: 19 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882792.212744:0:14475:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fa289fa6200/0xf4731e8a7c5e020a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4731e8a7c5e0203 expref: 19 pid: 14475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882792.212753:0:14475:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6200, rc 0) 00000100:00100000:1.0:1787882792.212810:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+19:14479:x1874730564033280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882792.212817:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787882792.212882:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf3fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564033280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787882792.212899:0:14479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ba00/0xf4731e8a7c5e0203 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e020a expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882792.212909:0:14479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ba00/0xf4731e8a7c5e0203 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4731e8a7c5e020a expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882792.212987:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564033408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882792.213044:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882792.213059:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787882792.213159:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564033408 00000100:00100000:1.0:1787882792.213164:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564033408 00000100:00100000:1.0:1787882792.213181:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787882792.213186:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+19:14479:x1874730564033408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882792.214792:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+19:14479:x1874730564033408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1597us (1740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882792.214804:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787882792.214862:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564033408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787882792.214919:0:14479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564033536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882792.214969:0:14479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882792.214988:0:14479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787882792.215004:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564033536 00000100:00100000:1.0:1787882792.215009:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564033536 00000100:00100000:1.0:1787882792.215048:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787882792.215056:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+19:14479:x1874730564033536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787882792.215207:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfcc18db-0526-4071-939f-14c6713c8186+19:14479:x1874730564033536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882792.215214:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787882792.215249:0:14479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c15aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bfcc18db-0526-4071-939f-14c6713c8186:14479:1874730564033536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787882792.215909:0:16688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787882792.215973:0:14479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787882792.215995:0:14479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787882792.216006:0:14479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ba00/0xf4731e8a7c5e0203 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e020a expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882792.216028:0:14479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fa2a791ba00/0xf4731e8a7c5e0203 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4731e8a7c5e020a expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.130463:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787882793.258183:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787882793.258207:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2bf43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564033664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882793.258293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882793.258428:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564033664 00000100:00100000:1.0:1787882793.258437:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564033664 00000100:00100000:1.0:1787882793.258501:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787882793.258511:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564033664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787882793.258545:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787882793.258594:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564033664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882793.258601:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787882793.258663:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882793.258733:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2bf43df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564033664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787882793.649097:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882793.649154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882793.649192:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882793.649225:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882793.649250:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882793.649255:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542023296 00000100:00100000:3.0:1787882793.649265:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542023296 00000100:00100000:1.0:1787882793.649274:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882793.649298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882793.649324:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542023808 00000100:00100000:3.0:1787882793.649328:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542023808 00000100:00100000:1.0:1787882793.649345:0:16451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542023424 00000100:00100000:3.0:1787882793.649347:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542023680 00000100:00100000:1.0:1787882793.649351:0:16451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542023424 00000100:00100000:3.0:1787882793.649352:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542023680 00000100:00100000:3.0:1787882793.649381:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:1.0:1787882793.649390:0:16451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:3.0:1787882793.649395:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2359:x1874730542023296:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882793.649404:0:16451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2359:x1874730542023808:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1787882793.649487:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542023040 00000100:00100000:2.0:1787882793.649491:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542023040 00000100:00100000:2.0:1787882793.649520:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:2.0:1787882793.649527:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:2359:x1874730542023040:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882793.649589:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542023552 00000100:00100000:0.0:1787882793.649594:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542023552 00000100:00100000:0.0:1787882793.649622:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542023168 00000100:00100000:0.0:1787882793.649625:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542023168 00000100:00100000:0.0:1787882793.649646:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:0.0:1787882793.649653:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:2359:x1874730542023552:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1787882793.649788:0:16451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2359:x1874730542023808:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 387us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882793.649801:0:16451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:1.0:1787882793.649819:0:16451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:1.0:1787882793.649826:0:16451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2359:x1874730542023680:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882793.655013:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2359:x1874730542023296:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5600us (5835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882793.655045:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1787882793.655083:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:3.0:1787882793.655096:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2359:x1874730542023424:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882793.655217:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2359:x1874730542023424:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 57us (5874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882793.655226:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:3.0:1787882793.655273:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:3.0:1787882793.655282:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+6:2359:x1874730542023168:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1787882793.655316:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+6:2359:x1874730542023168:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (6065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882793.655322:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00080000:3.0:1787882793.655346:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787882793.655351:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787882793.655354:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787882793.655734:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:2359:x1874730542023040:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 6204us (6648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882793.655743:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:0.0:1787882793.656178:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:2359:x1874730542023552:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 6190us (6651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882793.656190:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:1.0:1787882793.656741:0:16451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2359:x1874730542023680:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 6912us (7438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882793.656750:0:16451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:2.0:1787882793.889545:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882793.889988:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542023936 00000100:00100000:3.0:1787882793.889998:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542023936 00000100:00100000:3.0:1787882793.890075:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:3.0:1787882793.890086:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+6:14462:x1874730542023936:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882793.890105:0:15737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882793.890125:0:15737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265a00/0xf4731e8a7c5e0211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434b4 expref: -99 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.890193:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e0218 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.890225:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e0218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.890238:0:15737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e0218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.890255:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e021f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.890261:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e021f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.890267:0:15737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e021f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.890750:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5e0226 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.890760:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5e0226 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.890768:0:15737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5e0226 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882793.890899:0:15737:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787882793.890904:0:15737:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882793.891014:0:15737:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5e0226 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891027:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e0218 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891043:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e0218 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891050:0:15737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e0218 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891056:0:15737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882793.891061:0:15737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e0218 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891068:0:15737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e0218 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891080:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30400) 00010000:00010000:3.0:1787882793.891083:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882793.891087:0:15737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e0218 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891093:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e0218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891105:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e021f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891111:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e021f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891117:0:15737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e021f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891122:0:15737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882793.891130:0:15737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e021f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891136:0:15737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e021f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891144:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fa285a30200) 00010000:00010000:3.0:1787882793.891146:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882793.891149:0:15737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e021f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891154:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e021f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891191:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265a00/0xf4731e8a7c5e0211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434b4 expref: 8 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891204:0:15737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265200/0xf4731e8a7c5e0226 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434b4 expref: 7 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.891217:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa285a30300) 00010000:00010000:3.0:1787882793.891220:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787882793.891222:0:15737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265200, rc 0) 00000100:00100000:3.0:1787882793.891291:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+7:14462:x1874730542023936:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1206us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882793.891299:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:0.0:1787882793.900695:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882793.900803:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542024192 00000100:00100000:3.0:1787882793.900813:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542024192 00000100:00100000:3.0:1787882793.900895:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:3.0:1787882793.900905:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+7:14462:x1874730542024192:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882793.900939:0:16359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882793.900960:0:16359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e022d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434bb expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.901057:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0234 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.901074:0:16359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0234 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.901086:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0234 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.901147:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e023b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.901156:0:16359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e023b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.901162:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e023b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.901711:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5e0242 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.901722:0:16359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5e0242 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.901731:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5e0242 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882793.901742:0:16359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787882793.902089:0:16359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0234 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902098:0:16359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0234 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902104:0:16359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0234 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902110:0:16359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7265400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882793.902115:0:16359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0234 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902122:0:16359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0234 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902135:0:16359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fa285a30300) 00010000:00010000:3.0:1787882793.902138:0:16359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882793.902143:0:16359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0234 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902149:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0234 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902163:0:16359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e023b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902170:0:16359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e023b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902175:0:16359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e023b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902191:0:16359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882793.902194:0:16359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e023b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902200:0:16359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e023b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902207:0:16359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fa285a30e00) 00010000:00010000:3.0:1787882793.902210:0:16359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882793.902213:0:16359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e023b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902219:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e023b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902650:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e022d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434bb expref: 10 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902667:0:16359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265000/0xf4731e8a7c5e0242 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434bb expref: 9 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882793.902674:0:16359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa285a30500) 00010000:00010000:3.0:1787882793.902676:0:16359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882793.902679:0:16359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265000, rc 0) 00000100:00100000:3.0:1787882793.902753:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+9:14462:x1874730542024192:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1849us (2070us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787882793.902762:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:1.0:1787882793.912602:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882793.912742:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542024320 00000100:00100000:0.0:1787882793.912751:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542024320 00000100:00100000:0.0:1787882793.912814:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:0.0:1787882793.912825:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+9:14462:x1874730542024320:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787882793.912960:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+9:14462:x1874730542024320:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 Request processed in 136us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882793.912967:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:1.0:1787882793.976805:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882793.976905:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542024448 00000100:00100000:0.0:1787882793.976914:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542024448 00000100:00100000:0.0:1787882793.976970:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:0.0:1787882793.976981:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+9:14468:x1874730542024448:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1787882793.977014:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882793.977042:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0250 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434c2 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977116:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0257 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977130:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0257 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977142:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0257 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977174:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448000/0xf4731e8a7c5e025e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977181:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448000/0xf4731e8a7c5e025e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977187:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448000/0xf4731e8a7c5e025e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977712:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0257 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977721:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0257 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977727:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0257 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977733:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882793.977737:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0257 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977744:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0257 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977756:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30400) 00010000:00010000:0.0:1787882793.977759:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882793.977764:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0257 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977771:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0257 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977791:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448000/0xf4731e8a7c5e025e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977797:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448000/0xf4731e8a7c5e025e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977803:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448000/0xf4731e8a7c5e025e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977809:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882793.977812:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448000/0xf4731e8a7c5e025e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977818:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448000/0xf4731e8a7c5e025e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977826:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa289160a00) 00010000:00010000:0.0:1787882793.977828:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882793.977831:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448000/0xf4731e8a7c5e025e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.977836:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448000/0xf4731e8a7c5e025e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.979427:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0250 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434c2 expref: 10 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.979457:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30400) 00010000:00010000:0.0:1787882793.979460:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882793.979488:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0250 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434c2 expref: 10 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882793.979507:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b6449e00, rc 0) 00000100:00100000:1.0:1787882793.984595:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+9:14468:x1874730542024448:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 7603us (7787us total) trans 0 rc 301/301 00000100:00100000:1.0:1787882793.984622:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:1.0:1787882793.994404:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882793.995350:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542024576 00000100:00100000:2.0:1787882793.995367:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542024576 00000100:00100000:2.0:1787882793.995490:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:2.0:1787882793.995505:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c15a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:24be1cef-979a-4c79-bf95-de3d76f61b96+9:14468:x1874730542024576:12345-192.168.206.21@tcp:700:lfs.0 00000100:00100000:2.0:1787882793.995640:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c15a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:24be1cef-979a-4c79-bf95-de3d76f61b96+9:14468:x1874730542024576:12345-192.168.206.21@tcp:700:lfs.0 Request processed in 138us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882793.995656:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:3.0:1787882793.999202:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882794.000215:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542024832 00000100:00100000:0.0:1787882794.000232:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542024832 00000100:00100000:0.0:1787882794.000323:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:0.0:1787882794.000336:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+9:14468:x1874730542024832:12345-192.168.206.21@tcp:36:lfs.0 00010000:00010000:0.0:1787882794.000408:0:14482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882794.000442:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264600/0xf4731e8a7c5e0193 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84343d expref: 9 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.000465:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30400) 00010000:00010000:0.0:1787882794.000472:0:14482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787882794.001678:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.001705:0:14482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84349f expref: 5 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.001716:0:14482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.001766:0:14482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84349f expref: 5 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.001786:0:14482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84349f expref: 5 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882794.001825:0:14482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14482:1874730564033792:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882794.001992:0:14482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749000 going to sleep for 11 seconds 00000100:00100000:3.0:1787882794.004684:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882794.004809:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542024960 00000100:00100000:0.0:1787882794.004821:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542024960 00010000:00010000:0.0:1787882794.004914:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84349f expref: 6 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882794.004957:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:0.0:1787882794.004968:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa181d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:2357:x1874730542024960:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882794.004986:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882794.004994:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84349f expref: 6 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.005023:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84349f expref: 6 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.005070:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30400) 00010000:00010000:0.0:1787882794.005075:0:14469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.005086:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.005094:0:14469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.005117:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882794.005199:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa181d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:2357:x1874730542024960:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 232us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882794.005207:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00010000:00010000:1.0:1787882794.006757:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e01cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84349f expref: 5 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882794.006797:0:14482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14482:1874730564033792:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882794.006827:0:14482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.006839:0:14482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.006846:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.007173:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e026c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.007189:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e026c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.007203:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e026c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882794.010441:0:14482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787882794.010466:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.010480:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.010498:0:14482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.010505:0:14482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882794.010511:0:14482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.010520:0:14482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.010542:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30400) 00010000:00010000:1.0:1787882794.010545:0:14482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882794.010551:0:14482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.010558:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e0265 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787882794.010584:0:14482:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000db1ba11 reply state 00000000de59cbe1 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e026c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882794.010596:0:14482:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787882794.011200:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf43df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+10:14468:x1874730542024832:12345-192.168.206.21@tcp:36:lfs.0 Request processed in 10858us (12003us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787882794.011213:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00010000:00010000:3.0:1787882794.017091:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e026c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.017114:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e026c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.017122:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e026c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.017128:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882794.017133:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e026c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.017155:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e026c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.017176:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa283291600) 00010000:00010000:3.0:1787882794.017180:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882794.017185:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e026c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.017192:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e026c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882794.072351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882794.072610:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542025088 00000100:00100000:3.0:1787882794.072626:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542025088 00000100:00100000:3.0:1787882794.072727:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:3.0:1787882794.072740:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+9:14476:x1874730542025088:12345-192.168.206.21@tcp:101:lctl.0 00010000:00010000:3.0:1787882794.072772:0:15737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882794.072802:0:15737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e0273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434c9 expref: -99 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.072935:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e027a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.072951:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e027a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.072963:0:15737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e027a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882794.073052:0:15737:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787882794.073057:0:15737:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882794.073110:0:15737:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e027a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.073142:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e0273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434c9 expref: 11 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.073164:0:15737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264a00/0xf4731e8a7c5e027a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434c9 expref: 10 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.073175:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30e00) 00010000:00010000:3.0:1787882794.073178:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787882794.073183:0:15737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264a00, rc 0) 00000100:00100000:3.0:1787882794.073263:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+10:14476:x1874730542025088:12345-192.168.206.21@tcp:101:lctl.0 Request processed in 525us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882794.073271:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1787882794.094033:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882794.094217:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542025216 00000100:00100000:3.0:1787882794.094231:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542025216 00000100:00100000:3.0:1787882794.094334:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:3.0:1787882794.094348:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:14477:x1874730542025216:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882794.094377:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882794.094415:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e0281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434d0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.094504:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0288 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.094521:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.094535:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882794.094624:0:14483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787882794.094629:0:14483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882794.094662:0:14483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.094691:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e0281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434d0 expref: 7 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.094715:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265400/0xf4731e8a7c5e0288 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434d0 expref: 6 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.094724:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30e00) 00010000:00010000:3.0:1787882794.094728:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787882794.094733:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265400, rc 0) 00000100:00100000:3.0:1787882794.095332:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:14477:x1874730542025216:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 982us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882794.095354:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:0.0:1787882794.101234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882794.101786:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542025344 00000100:00100000:1.0:1787882794.101799:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542025344 00000100:00100000:1.0:1787882794.101950:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:1.0:1787882794.101962:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:14477:x1874730542025344:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1787882794.102015:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882794.106626:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e028f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434d7 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.106762:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0296 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.106780:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0296 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.106794:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0296 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.106814:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5e029d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.106821:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5e029d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.106828:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5e029d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109032:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e02a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109063:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e02a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109076:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e02a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882794.109169:0:14482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787882794.109196:0:14482:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787882794.109233:0:14482:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e02a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109251:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0296 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109258:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0296 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109266:0:14482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0296 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109273:0:14482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882794.109278:0:14482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0296 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109286:0:14482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0296 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109303:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30e00) 00010000:00010000:1.0:1787882794.109306:0:14482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882794.109312:0:14482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0296 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109319:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0296 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109339:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5e029d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109346:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5e029d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109364:0:14482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5e029d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109370:0:14482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882794.109374:0:14482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5e029d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109380:0:14482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5e029d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109389:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa283291100) 00010000:00010000:1.0:1787882794.109768:0:14482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882794.109775:0:14482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5e029d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109782:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7e00/0xf4731e8a7c5e029d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109836:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e028f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434d7 expref: 8 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109853:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e02a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434d7 expref: 7 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.109862:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa283291800) 00010000:00010000:1.0:1787882794.109864:0:14482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787882794.109867:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6400, rc 0) 00000100:00100000:1.0:1787882794.110133:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+7:14477:x1874730542025344:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 8170us (9002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882794.110155:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:0.0:1787882794.118857:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882794.119709:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542025600 00000100:00100000:3.0:1787882794.119724:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542025600 00000100:00100000:3.0:1787882794.119933:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:3.0:1787882794.119947:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0011688e-6324-4e6f-a6c4-bb79489cb0d9+7:14477:x1874730542025600:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882794.119978:0:15737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882794.120018:0:15737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e02ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434de expref: -99 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882794.120255:0:15737:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787882794.120404:0:15737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e02ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434de expref: 9 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.120421:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30e00) 00010000:00010000:3.0:1787882794.120424:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787882794.120430:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e02ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434de expref: 9 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.120445:0:15737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264e00, rc 0) 00000100:00100000:3.0:1787882794.120539:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0011688e-6324-4e6f-a6c4-bb79489cb0d9+8:14477:x1874730542025600:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 595us (1695us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787882794.120547:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:3.0:1787882794.126393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882794.126473:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542025856 00000100:00100000:1.0:1787882794.126487:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542025856 00000100:00100000:1.0:1787882794.126570:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:1.0:1787882794.126583:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+8:14477:x1874730542025856:12345-192.168.206.21@tcp:36:lfs.0 00010000:00010000:1.0:1787882794.126670:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882794.126706:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e02a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434d7 expref: 8 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.126727:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa283291800) 00010000:00010000:1.0:1787882794.126740:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787882794.126781:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e02b9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.126800:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e02b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.126812:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e02b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787882794.127328:0:14483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aed3a576 reply state 00000000ab8743d1 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e02b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882794.127341:0:14483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787882794.127358:0:14483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787882794.127468:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+9:14477:x1874730542025856:12345-192.168.206.21@tcp:36:lfs.0 Request processed in 887us (1088us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787882794.127477:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:0.0:1787882794.131413:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882794.132045:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542026112 00000100:00100000:2.0:1787882794.132059:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542026112 00000100:00100000:2.0:1787882794.132141:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:2.0:1787882794.132153:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+9:14477:x1874730542026112:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1787882794.132636:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+10:14477:x1874730542026112:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 334us (1098us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787882794.132647:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00010000:00010000:3.0:1787882794.137564:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e02b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.137590:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e02b9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.137607:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e02b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.137615:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882794.137621:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e02b9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.137631:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e02b9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.137653:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa283291100) 00010000:00010000:3.0:1787882794.137656:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787882794.137661:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e02b9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.137668:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6600/0xf4731e8a7c5e02b9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882794.138353:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882794.138525:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542026368 00000100:00100000:1.0:1787882794.138540:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542026368 00000100:00100000:1.0:1787882794.138609:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:1.0:1787882794.138621:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+9:14477:x1874730542026368:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1787882794.138652:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882794.138675:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e02c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434e5 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.138767:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e02c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.138791:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e02c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.138802:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e02c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.138819:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e02ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.138827:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e02ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.138835:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e02ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882794.139055:0:14482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787882794.139672:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e02c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139684:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e02c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139710:0:14482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e02c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139717:0:14482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882794.139722:0:14482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e02c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139731:0:14482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e02c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139748:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30e00) 00010000:00010000:1.0:1787882794.139751:0:14482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882794.139756:0:14482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e02c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139762:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e02c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139792:0:14482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e02ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139800:0:14482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e02ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139805:0:14482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e02ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139810:0:14482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882794.139813:0:14482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e02ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139828:0:14482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e02ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139836:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa283291800) 00010000:00010000:1.0:1787882794.139838:0:14482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882794.139841:0:14482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e02ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139847:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e02ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139941:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e02c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434e5 expref: 11 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139953:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30e00) 00010000:00010000:1.0:1787882794.139955:0:14482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787882794.139958:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e02c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434e5 expref: 11 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.139969:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6400, rc 0) 00000100:00100000:1.0:1787882794.140069:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+10:14477:x1874730542026368:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1449us (1722us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1787882794.140079:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:1.0:1787882794.145717:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882794.145849:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542026496 00000100:00100000:3.0:1787882794.145863:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542026496 00000100:00100000:2.0:1787882794.148240:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:2.0:1787882794.148258:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0011688e-6324-4e6f-a6c4-bb79489cb0d9+10:14477:x1874730542026496:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1787882794.148291:0:15737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882794.148328:0:15737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5e02dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434ec expref: -99 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.148441:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.148458:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.148473:0:15737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882794.148567:0:15737:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787882794.148572:0:15737:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882794.148600:0:15737:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.148636:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5e02dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434ec expref: 12 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.148681:0:15737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434ec expref: 11 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.148691:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa28b9aca00) 00010000:00010000:2.0:1787882794.148694:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787882794.148697:0:15737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791b200, rc 0) 00000100:00100000:2.0:1787882794.149272:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0011688e-6324-4e6f-a6c4-bb79489cb0d9+11:14477:x1874730542026496:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1013us (3565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882794.149282:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:1.0:1787882794.152612:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882794.152721:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542026624 00000100:00100000:2.0:1787882794.152737:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542026624 00000100:00100000:2.0:1787882794.153152:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:2.0:1787882794.153167:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+11:14477:x1874730542026624:12345-192.168.206.21@tcp:37:lfs.0 00010000:00010000:3.0:1787882794.154750:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882794.158646:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+11:14477:x1874730542026624:12345-192.168.206.21@tcp:37:lfs.0 Request processed in 5466us (6035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882794.158671:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:1.0:1787882794.162194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882794.162298:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542026880 00000100:00100000:0.0:1787882794.162311:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542026880 00000100:00100000:0.0:1787882794.162377:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:0.0:1787882794.162389:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf775850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+11:14477:x1874730542026880:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1787882794.163894:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf775850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+12:14477:x1874730542026880:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 1479us (1700us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787882794.163909:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:1.0:1787882794.209513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882794.209664:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542027008 00000100:00100000:0.0:1787882794.209681:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542027008 00000100:00100000:0.0:1787882794.209765:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:0.0:1787882794.209802:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+10:14484:x1874730542027008:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1787882794.209831:0:16359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882794.209859:0:16359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e02ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434f3 expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210012:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e02f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210031:0:16359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e02f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210044:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e02f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210064:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e02f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210071:0:16359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e02f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210078:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e02f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210222:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449200/0xf4731e8a7c5e02ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210231:0:16359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449200/0xf4731e8a7c5e02ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210239:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449200/0xf4731e8a7c5e02ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882794.210297:0:16359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787882794.210302:0:16359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882794.210357:0:16359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449200/0xf4731e8a7c5e02ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210373:0:16359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e02f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210379:0:16359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e02f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210386:0:16359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e02f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210393:0:16359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6449400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882794.210399:0:16359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e02f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210407:0:16359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e02f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210421:0:16359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30e00) 00010000:00010000:0.0:1787882794.210425:0:16359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882794.210430:0:16359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e02f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210437:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e02f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210454:0:16359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e02f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210470:0:16359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e02f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210476:0:16359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e02f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210481:0:16359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882794.210485:0:16359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e02f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210491:0:16359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e02f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210500:0:16359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fa289160a00) 00010000:00010000:0.0:1787882794.210502:0:16359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882794.210505:0:16359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e02f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210511:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e02f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210548:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e02ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434f3 expref: 12 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210561:0:16359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449200/0xf4731e8a7c5e02ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434f3 expref: 11 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.210569:0:16359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa28b9aca00) 00010000:00010000:0.0:1787882794.210571:0:16359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787882794.210579:0:16359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b6449200, rc 0) 00000100:00100000:0.0:1787882794.210678:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+11:14484:x1874730542027008:12345-192.168.206.21@tcp:101:bash.0 Request processed in 878us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882794.210688:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:2.0:1787882794.218806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882794.219930:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542027264 00000100:00100000:1.0:1787882794.219966:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542027264 00000100:00100000:1.0:1787882794.220061:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:1.0:1787882794.220076:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+11:14484:x1874730542027264:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1787882794.220105:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882794.220134:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0306 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a8434fa expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.220315:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.220331:0:14484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434ec expref: 11 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.220343:0:14484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.220387:0:14484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434ec expref: 11 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.220404:0:14484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434ec expref: 11 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882794.220420:0:14484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b9875c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14484:1874730564033920:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882794.220575:0:14484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2bf749e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787882794.223042:0:14484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b9875c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14484:1874730564033920:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882794.223087:0:14484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882794.225672:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882794.226517:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542027392 00000100:00100000:0.0:1787882794.226536:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542027392 00010000:00010000:0.0:1787882794.226589:0:14468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434ec expref: 12 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882794.226640:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:0.0:1787882794.226651:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+12:2356:x1874730542027392:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882794.226668:0:14468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882794.226676:0:14468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434ec expref: 12 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.226692:0:14468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434ec expref: 12 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.226719:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b200/0xf4731e8a7c5e02e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434ec expref: 12 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.226740:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa28b9aca00) 00010000:00010000:0.0:1787882794.226746:0:14468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.226756:0:14468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.226764:0:14468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.226825:0:14468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787882794.226909:0:14484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.226920:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.226950:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e0314 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.226961:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e0314 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.226970:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e0314 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882794.227310:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+11:2356:x1874730542027392:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 656us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882794.227320:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00010000:00010000:1.0:1787882794.231785:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e031b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.231818:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e031b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.231832:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e031b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882794.231847:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787882794.231906:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.231914:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.231922:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.231946:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7a00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882794.231952:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.231960:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.231976:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa28b9aca00) 00010000:00010000:1.0:1787882794.231980:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882794.231985:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.231991:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7a00/0xf4731e8a7c5e030d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787882794.232022:0:14484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3604c7b reply state 00000000e89bc1fe transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e0314 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882794.232034:0:14484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787882794.232081:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6a00/0xf4731e8a7c5e0306 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434fa expref: 14 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.232096:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e031b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434fa expref: 13 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.232103:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:1.0:1787882794.232105:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787882794.232107:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6400, rc 0) 00000100:00100000:1.0:1787882794.232185:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+14:14484:x1874730542027264:12345-192.168.206.21@tcp:101:bash.0 Request processed in 12112us (13395us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787882794.232200:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00010000:00010000:3.0:1787882794.250518:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e0314 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.250544:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e0314 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.250581:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e0314 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.250588:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882794.250594:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e0314 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.250605:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e0314 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.250639:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fa283291800) 00010000:00010000:3.0:1787882794.250643:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882794.250649:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e0314 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.250655:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7c00/0xf4731e8a7c5e0314 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882794.253128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882794.253457:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542027520 00000100:00100000:0.0:1787882794.253472:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542027520 00000100:00100000:0.0:1787882794.253543:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:0.0:1787882794.253556:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+13:14484:x1874730542027520:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1787882794.253587:0:15737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882794.253613:0:15737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e0329 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843501 expref: -99 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.253711:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.253728:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.253739:0:15737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787882794.253798:0:15737:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787882794.253803:0:15737:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787882794.253826:0:15737:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.253838:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.253912:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e0329 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843501 expref: 15 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.253952:0:15737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843501 expref: 14 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.253961:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:0.0:1787882794.253964:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787882794.253968:0:15737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b6448c00, rc 0) 00000100:00100000:0.0:1787882794.254053:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf3fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+14:14484:x1874730542027520:12345-192.168.206.21@tcp:101:bash.0 Request processed in 499us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882794.254062:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:1.0:1787882794.259241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882794.259793:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542027776 00000100:00100000:3.0:1787882794.259808:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542027776 00000100:00100000:3.0:1787882794.259916:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:3.0:1787882794.259929:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+14:14484:x1874730542027776:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:3.0:1787882794.260903:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+15:14484:x1874730542027776:12345-192.168.206.21@tcp:35:bash.0 Request processed in 493us (1196us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787882794.260917:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:1.0:1787882794.376017:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882794.376136:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542028032 00000100:00100000:3.0:1787882794.376150:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542028032 00000100:00100000:3.0:1787882794.376226:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:3.0:1787882794.376258:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+15:14494:x1874730542028032:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1787882794.376290:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882794.376317:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e0337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843508 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882794.376653:0:14482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787882794.377856:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e0337 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843508 expref: 17 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.377897:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fa285a30e00) 00010000:00010000:3.0:1787882794.377901:0:14482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787882794.377908:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e0337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843508 expref: 17 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.377926:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264e00, rc 0) 00000100:00100000:3.0:1787882794.378028:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+16:14494:x1874730542028032:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1772us (2036us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787882794.378039:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:2.0:1787882794.383194:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882794.386632:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542028288 00000100:00100000:0.0:1787882794.386947:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542028288 00000100:00100000:0.0:1787882794.387099:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:0.0:1787882794.387114:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+16:14494:x1874730542028288:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1787882794.387489:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+17:14494:x1874730542028288:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 377us (4310us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787882794.387498:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:1.0:1787882794.431440:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882794.431621:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542028544 00000100:00100000:0.0:1787882794.431635:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542028544 00000100:00100000:0.0:1787882794.431712:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:0.0:1787882794.431725:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+17:14497:x1874730542028544:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1787882794.431758:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882794.431795:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e0345 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84350f expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.432232:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e034c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.432251:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e034c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.432265:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e034c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882794.432280:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787882794.433029:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449400/0xf4731e8a7c5e0345 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84350f expref: 20 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.433090:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e034c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84350f expref: 19 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.433100:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:3.0:1787882794.433104:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882794.433107:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264e00, rc 0) 00000100:00100000:3.0:1787882794.433199:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+19:14497:x1874730542028544:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1476us (1779us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787882794.433208:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:2.0:1787882794.436307:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882794.437101:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542028672 00000100:00100000:3.0:1787882794.437117:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542028672 00000100:00100000:3.0:1787882794.437203:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:3.0:1787882794.437216:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+19:2356:x1874730542028672:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787882794.437241:0:14467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787882794.437275:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e034c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84350f expref: 19 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.437299:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:3.0:1787882794.437305:0:14467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787882794.439684:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+18:2356:x1874730542028672:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 2454us (3373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882794.439702:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:1.0:1787882794.439850:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882794.441949:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542028800 00000100:00100000:0.0:1787882794.441989:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542028800 00000100:00100000:0.0:1787882794.442078:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:0.0:1787882794.442091:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+18:14497:x1874730542028800:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:0.0:1787882794.442188:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e035a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.442211:0:16359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e035a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.442225:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e035a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.442259:0:16359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e035a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.442266:0:16359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e035a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.442274:0:16359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e035a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.442281:0:16359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6449800 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882794.442287:0:16359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e035a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.442296:0:16359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e035a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.442309:0:16359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:0.0:1787882794.442312:0:16359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787882794.442316:0:16359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e035a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.442332:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449800/0xf4731e8a7c5e035a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882794.442485:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+18:14497:x1874730542028800:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 396us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882794.442494:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:0.0:1787882794.455224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882794.456080:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542029056 00000100:00100000:3.0:1787882794.456097:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542029056 00000100:00100000:3.0:1787882794.456213:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:3.0:1787882794.456248:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+18:14497:x1874730542029056:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1787882794.456585:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+19:14497:x1874730542029056:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 342us (1377us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787882794.456594:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000040:00080000:2.0:1787882794.671016:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787882794.724460:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882794.724614:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542029312 00000100:00100000:3.0:1787882794.724628:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542029312 00000100:00100000:3.0:1787882794.724697:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:3.0:1787882794.724709:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+19:14528:x1874730542029312:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:3.0:1787882794.724738:0:14482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882794.724762:0:14482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e0361 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843516 expref: -99 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.724925:0:14482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265a00/0xf4731e8a7c5e0368 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.724942:0:14482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265a00/0xf4731e8a7c5e0368 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.724955:0:14482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265a00/0xf4731e8a7c5e0368 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14482 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882794.724968:0:14482:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787882794.725161:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e0361 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843516 expref: 22 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.725182:0:14482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265a00/0xf4731e8a7c5e0368 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843516 expref: 21 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.725216:0:14482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:3.0:1787882794.725219:0:14482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882794.725223:0:14482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7265a00, rc 0) 00000100:00100000:3.0:1787882794.725308:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+21:14528:x1874730542029312:12345-192.168.206.21@tcp:101:cat.0 Request processed in 600us (870us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787882794.725317:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:1.0:1787882794.731037:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882794.731342:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542029568 00000100:00100000:0.0:1787882794.731356:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542029568 00000100:00100000:0.0:1787882794.731422:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1787882794.731433:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+21:14528:x1874730542029568:12345-192.168.206.21@tcp:35:cat.0 00000100:00100000:0.0:1787882794.732230:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+22:14528:x1874730542029568:12345-192.168.206.21@tcp:35:cat.0 Request processed in 792us (1198us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787882794.732241:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1787882794.744920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882794.745323:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542029696 00000100:00100000:2.0:1787882794.745337:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542029696 00000100:00100000:2.0:1787882794.745429:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:2.0:1787882794.745444:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+22:2356:x1874730542029696:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882794.745465:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882794.745814:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7265a00/0xf4731e8a7c5e0368 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843516 expref: 22 pid: 14482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.745838:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:2.0:1787882794.745844:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882794.746175:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+21:2356:x1874730542029696:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 732us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882794.746185:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:2.0:1787882794.827522:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882794.827639:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542029952 00000100:00100000:3.0:1787882794.827651:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542029952 00000100:00100000:3.0:1787882794.827781:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:3.0:1787882794.827795:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+21:14534:x1874730542029952:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:3.0:1787882794.827829:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882794.827855:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e0376 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84351d expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.828026:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e037d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.828044:0:14484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e031b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434fa expref: 22 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.828054:0:14484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843501 expref: 22 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.828074:0:14484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e037d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.828119:0:14484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843501 expref: 22 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.828153:0:14484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843501 expref: 22 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882794.828170:0:14484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14484:1874730564034048:192.168.206.21@tcp:104: 00010000:00010000:3.0:1787882794.828311:0:14484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e031b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434fa expref: 22 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.828321:0:14484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e031b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434fa expref: 22 pid: 14484 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882794.828330:0:14484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2af5da680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14484:1874730564034176:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882794.828356:0:14484:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2b717f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882794.832959:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882794.832981:0:14484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14484:1874730564034048:192.168.206.21@tcp:104: 00000100:00100000:1.0:1787882794.833011:0:14484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2af5da680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14484:1874730564034176:192.168.206.21@tcp:104: 00000100:00100000:3.0:1787882794.833019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:1.0:1787882794.833062:0:14484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e037d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882794.833155:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542030080 00000100:00100000:0.0:1787882794.833155:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542030208 00000100:00100000:2.0:1787882794.833163:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542030080 00000100:00100000:0.0:1787882794.833163:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542030208 00010000:00010000:2.0:1787882794.833215:0:14468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843501 expref: 24 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.833215:0:14467:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e031b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434fa expref: 24 pid: 14484 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882794.833262:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:2.0:1787882794.833268:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:0.0:1787882794.833272:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b5550050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+24:2356:x1874730542030080:12345-192.168.206.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787882794.833274:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+24:2356:x1874730542030208:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882794.833289:0:14468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882794.833289:0:14467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882794.833297:0:14468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e031b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434fa expref: 24 pid: 14484 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.833297:0:14467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843501 expref: 24 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.833312:0:14468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e031b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434fa expref: 24 pid: 14484 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.833342:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e031b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a8434fa expref: 24 pid: 14484 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.833540:0:14467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843501 expref: 23 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.833554:0:14467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448c00/0xf4731e8a7c5e0330 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843501 expref: 23 pid: 15737 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.833566:0:14467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:0.0:1787882794.833572:0:14467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e037d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.833582:0:14467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e037d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.833590:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e037d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.833676:0:14467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882794.833752:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b5550050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+22:2356:x1874730542030080:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 481us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882794.833761:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00010000:00010000:1.0:1787882794.834550:0:14484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e037d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.834564:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e037d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882794.834592:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787882794.835468:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264e00/0xf4731e8a7c5e0376 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84351d expref: 23 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.835494:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264800/0xf4731e8a7c5e037d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84351d expref: 22 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.835505:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:1.0:1787882794.835508:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787882794.835511:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264800, rc 0) 00000100:00100000:1.0:1787882794.835596:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+22:14534:x1874730542029952:12345-192.168.206.21@tcp:101:dd.0 Request processed in 7804us (8090us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787882794.835608:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 34 00010000:00010000:2.0:1787882794.835788:0:14468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:2.0:1787882794.835801:0:14468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882794.835827:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+21:2356:x1874730542030208:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 2552us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882794.835836:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:2.0:1787882794.840024:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882794.840971:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542030464 00000100:00100000:1.0:1787882794.840987:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542030464 00000100:00100000:1.0:1787882794.841096:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:1.0:1787882794.841110:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+21:14534:x1874730542030464:12345-192.168.206.21@tcp:36:dd.0 00010000:00010000:1.0:1787882794.841491:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e038b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.841516:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e038b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.841532:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e038b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787882794.841600:0:14483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787882794.841641:0:14483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054bcacb5 reply state 00000000996685ff transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e038b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882794.841652:0:14483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787882794.841804:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+24:14534:x1874730542030464:12345-192.168.206.21@tcp:36:dd.0 Request processed in 694us (1801us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787882794.841813:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 35 00000020:00080000:1.0:1787882794.841820:0:14483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787882794.845531:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882794.847300:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542030592 00000100:00100000:2.0:1787882794.847320:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542030592 00000100:00100000:2.0:1787882794.847406:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:2.0:1787882794.847419:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+24:14534:x1874730542030592:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1787882794.847455:0:15737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882794.847483:0:15737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0392 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843524 expref: -99 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.847563:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0392 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843524 expref: 25 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.847579:0:15737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0392 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843524 expref: 25 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.847604:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:2.0:1787882794.847608:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787882794.847613:0:15737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791a400, rc 0) 00000100:00100000:2.0:1787882794.847697:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+25:14534:x1874730542030592:12345-192.168.206.21@tcp:101:dd.0 Request processed in 281us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882794.847704:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00010000:00010000:0.0:1787882794.853056:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e038b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.853080:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e038b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.853090:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e038b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.853126:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882794.853134:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e038b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.853142:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e038b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.853172:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:0.0:1787882794.853176:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882794.853182:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e038b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882794.853189:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e038b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882794.878345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882794.879663:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542030848 00000100:00100000:2.0:1787882794.879682:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542030848 00000100:00100000:2.0:1787882794.879808:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:2.0:1787882794.879840:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+24:14534:x1874730542030848:12345-192.168.206.21@tcp:103:dd.0 00010000:00010000:2.0:1787882794.880169:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882794.880205:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0392 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843524 expref: 24 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882794.880230:0:14469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:2.0:1787882794.880236:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882794.880372:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+23:14534:x1874730542030848:12345-192.168.206.21@tcp:103:dd.0 Request processed in 534us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882794.880382:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:1.0:1787882794.885795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882794.886150:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542030976 00000100:00100000:3.0:1787882794.886164:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542030976 00000100:00100000:3.0:1787882794.886241:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:3.0:1787882794.886254:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+23:14534:x1874730542030976:12345-192.168.206.21@tcp:58:dd.0 00010000:00010000:3.0:1787882794.886382:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.886404:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882794.886445:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787882794.888519:0:14484:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787882794.888708:0:14484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787882794.889419:0:14484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787882794.889625:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+23:14534:x1874730542030976:12345-192.168.206.21@tcp:58:dd.0 Request processed in 3366us (3848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882794.889639:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:3.0:1787882794.894310:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882794.894483:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542031104 00000100:00100000:1.0:1787882794.894497:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542031104 00000100:00100000:1.0:1787882794.894634:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:1.0:1787882794.894648:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+23:14534:x1874730542031104:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:1.0:1787882794.894705:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882794.894738:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e03a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84352b expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.894840:0:14483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.894912:0:14483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e03a0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84352b expref: 24 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.894940:0:14483:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.894956:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e03a0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84352b expref: 24 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.894972:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:1.0:1787882794.894977:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787882794.894981:0:14483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e03a0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84352b expref: 24 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882794.894991:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa7800, rc 0) 00000100:00100000:1.0:1787882794.895088:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+24:14534:x1874730542031104:12345-192.168.206.21@tcp:101:dd.0 Request processed in 443us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882794.895097:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00010000:00010000:3.0:1787882795.178231:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787882795.690210:0:14516:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787882795.690223:0:14516:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787882795.690300:0:14516:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787882795.690308:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787882795.690480:0:14516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b6169180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14516:1874730564034304:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787882795.690620:0:14516:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29daf0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787882795.695268:0:14516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b6169180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14516:1874730564034304:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787882795.707834:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882795.708184:0:14493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542031232 00000100:00100000:2.0:1787882795.708198:0:14493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542031232 00000100:00100000:2.0:1787882795.708344:0:14493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:2.0:1787882795.708358:0:14493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:24be1cef-979a-4c79-bf95-de3d76f61b96+24:14535:x1874730542031232:12345-192.168.206.21@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787882795.708476:0:14493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:24be1cef-979a-4c79-bf95-de3d76f61b96+24:14535:x1874730542031232:12345-192.168.206.21@tcp:900:lhsmtool_posix.0 Request processed in 122us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882795.708485:0:14493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00080000:3.0:1787882795.708541:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787882795.715225:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882795.715980:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542031360 00000100:00100000:0.0:1787882795.716004:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542031360 00000100:00100000:0.0:1787882795.716092:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:0.0:1787882795.716105:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+24:14535:x1874730542031360:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787882795.716150:0:16359:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787882795.716300:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+24:14535:x1874730542031360:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 197us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882795.716308:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:0.0:1787882795.727856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882795.728516:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542031488 00000100:00100000:3.0:1787882795.728532:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542031488 00000100:00100000:3.0:1787882795.728605:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:3.0:1787882795.728617:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+24:14535:x1874730542031488:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787882795.728707:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e03a7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.728726:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e03a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.728740:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e03a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731489:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731528:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731607:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731641:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731650:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731726:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787882795.731767:0:14484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787882795.731771:0:14484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787882795.731783:0:14484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731795:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e03a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731801:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e03a7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731808:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e03a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731813:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264000 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882795.731817:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e03a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731830:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e03a7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731843:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa285a30500) 00010000:00010000:3.0:1787882795.731846:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882795.731850:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e03a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731857:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264000/0xf4731e8a7c5e03a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731891:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731897:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03ae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731903:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731907:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264c00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882795.731910:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731915:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03ae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731922:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9fa285a30200) 00010000:00010000:3.0:1787882795.731925:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882795.731927:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03ae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731944:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731959:0:14484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731964:0:14484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731969:0:14484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731973:0:14484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882795.731976:0:14484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731981:0:14484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.731987:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:3.0:1787882795.731989:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882795.732004:0:14484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.732010:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882795.732270:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+24:14535:x1874730542031488:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 Request processed in 3650us (4426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882795.732372:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:3.0:1787882795.736020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882795.736363:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542031744 00000100:00100000:1.0:1787882795.736379:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542031744 00000100:00100000:1.0:1787882795.736462:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:1.0:1787882795.736490:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+24:14535:x1874730542031744:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787882795.736512:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787882795.736531:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843532 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736634:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736649:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736675:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787882795.736686:0:14483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787882795.736780:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736787:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736793:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736798:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882795.736803:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736809:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736820:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:1.0:1787882795.736828:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787882795.736833:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736838:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736923:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03bc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843532 expref: 26 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736934:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fa285a30500) 00010000:00010000:1.0:1787882795.736937:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787882795.736942:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843532 expref: 26 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.736953:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa289fa6e00, rc 0) 00000100:00100000:1.0:1787882795.737032:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+25:14535:x1874730542031744:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 546us (1037us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787882795.737039:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:2.0:1787882795.741742:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882795.742017:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542031872 00000100:00100000:1.0:1787882795.742030:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542031872 00000100:00100000:1.0:1787882795.742112:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:1.0:1787882795.742128:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+25:14535:x1874730542031872:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787882795.742179:0:14482:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787882795.742333:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+25:14535:x1874730542031872:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 209us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882795.742342:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:0.0:1787882795.748244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882795.751593:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542032128 00000100:00100000:3.0:1787882795.751615:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542032128 00000100:00100000:3.0:1787882795.751691:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:3.0:1787882795.751703:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+25:14535:x1874730542032128:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882795.751733:0:14484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882795.751759:0:14484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843539 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787882795.752624:0:14484:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1787882795.752635:0:14484:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787882795.752695:0:14484:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1787882795.753106:0:14484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.753127:0:14484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.753141:0:14484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.753219:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e03d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843539 expref: 28 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.753240:0:14484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843539 expref: 27 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.753251:0:14484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa285a30200) 00010000:00010000:3.0:1787882795.753254:0:14484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787882795.753266:0:14484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264c00, rc 0) 00000100:00100000:3.0:1787882795.753371:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+27:14535:x1874730542032128:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1668us (5154us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787882795.753381:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:3.0:1787882795.760148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882795.760284:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542032384 00000100:00100000:1.0:1787882795.760317:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542032384 00000100:00100000:1.0:1787882795.760394:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:1.0:1787882795.760407:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+27:14535:x1874730542032384:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787882795.760488:0:14483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787882795.760526:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264c00/0xf4731e8a7c5e03d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843539 expref: 27 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.760549:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa285a30200) 00010000:00010000:1.0:1787882795.760562:0:14483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787882795.760590:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.760605:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.760615:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.763942:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4cdcd554 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.763973:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4cdcd554 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.763988:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4cdcd554 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764183:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764191:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03e6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764217:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764224:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882795.764229:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764511:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03e6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764528:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fa28b9aca00) 00010000:00010000:1.0:1787882795.764532:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882795.764537:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764544:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6e00/0xf4731e8a7c5e03e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764560:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4cdcd554 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764566:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4cdcd554 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764572:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4cdcd554 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764576:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:1.0:1787882795.764579:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4cdcd554 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764596:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4cdcd554 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764603:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4cdcd554 (ffff9fa283291800) 00010000:00010000:1.0:1787882795.764606:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787882795.764608:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4cdcd554 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.764614:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa6400/0xf4731e8a7c5e03ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4cdcd554 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882795.765135:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+26:14535:x1874730542032384:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 4655us (4944us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787882795.765148:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:2.0:1787882795.769146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882795.769379:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542032512 00000100:00100000:0.0:1787882795.769395:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542032512 00000100:00100000:0.0:1787882795.769516:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:0.0:1787882795.769549:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+26:14535:x1874730542032512:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882795.769579:0:15737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882795.769609:0:15737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449600/0xf4731e8a7c5e03f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843540 expref: -99 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.769657:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449c00/0xf4731e8a7c5e03fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.769674:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449c00/0xf4731e8a7c5e03fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.769688:0:15737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449c00/0xf4731e8a7c5e03fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.769833:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449600/0xf4731e8a7c5e03f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843540 expref: 28 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.769854:0:15737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449c00/0xf4731e8a7c5e03fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843540 expref: 27 pid: 15737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.769864:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:0.0:1787882795.769903:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787882795.769909:0:15737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b6449c00, rc 0) 00000100:00100000:0.0:1787882795.769983:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+27:14535:x1874730542032512:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 437us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882795.770001:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:0.0:1787882795.777785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882795.777909:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542032768 00000100:00100000:3.0:1787882795.777924:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542032768 00000100:00100000:3.0:1787882795.778007:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:3.0:1787882795.778021:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+27:14535:x1874730542032768:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787882795.778137:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e0402 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.778158:0:16359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e0402 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.778172:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e0402 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787882795.779109:0:16359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1787882795.779127:0:16359:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 511928256613ns, next at 512928252793ns, rc = 0 00000004:00010000:3.0:1787882795.779261:0:16359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001682e44f reply state 0000000071ab8228 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e0402 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882795.779274:0:16359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787882795.779572:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+29:14535:x1874730542032768:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 1402us (1650us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787882795.779581:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:1.0:1787882795.791168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882795.791292:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542032896 00000100:00100000:0.0:1787882795.791317:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542032896 00000100:00100000:0.0:1787882795.791398:0:14483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:0.0:1787882795.791410:0:14483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+29:14535:x1874730542032896:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882795.791441:0:14483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882795.791468:0:14483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0409 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843547 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.791550:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0409 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843547 expref: 30 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.791566:0:14483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0409 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843547 expref: 30 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.791590:0:14483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:0.0:1787882795.791593:0:14483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787882795.791599:0:14483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b6448600, rc 0) 00000100:00100000:0.0:1787882795.791670:0:14483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+30:14535:x1874730542032896:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 261us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882795.791677:0:14483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 47 00010000:00010000:3.0:1787882795.793931:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e0402 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.793975:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e0402 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.793984:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e0402 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.793990:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882795.794006:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e0402 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.794016:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e0402 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.794036:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:3.0:1787882795.794039:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787882795.794044:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e0402 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.794051:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264200/0xf4731e8a7c5e0402 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882795.795525:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882795.795613:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542033024 00000100:00100000:1.0:1787882795.795626:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542033024 00000100:00100000:1.0:1787882795.795775:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:1.0:1787882795.795788:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2af5db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2357:x1874730542033024:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787882795.796328:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2af5db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+6:2357:x1874730542033024:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 539us (811us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787882795.796336:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00080000:3.0:1787882795.796522:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882795.804772:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882795.804970:0:14485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542033280 00000100:00100000:3.0:1787882795.804983:0:14485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542033280 00000100:00100000:3.0:1787882795.805221:0:14485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:3.0:1787882795.805234:0:14485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+29:14535:x1874730542033280:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787882795.805756:0:14485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+30:14535:x1874730542033280:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 522us (997us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787882795.805790:0:14485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:2.0:1787882795.811808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882795.816017:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542033536 00000100:00100000:0.0:1787882795.816037:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542033536 00000100:00100000:0.0:1787882795.816137:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:0.0:1787882795.816149:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+30:14535:x1874730542033536:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787882795.816342:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+30:14535:x1874730542033536:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 188us (4546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882795.816351:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:2.0:1787882795.821819:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882795.822215:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542033664 00000100:00100000:3.0:1787882795.822232:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542033664 00000100:00100000:2.0:1787882795.822508:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:2.0:1787882795.822523:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+30:14535:x1874730542033664:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787882795.822553:0:16359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787882795.822582:0:16359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a200/0xf4731e8a7c5e0410 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84354e expref: -99 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.822679:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5e0417 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.822696:0:16359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5e0417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.822708:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5e0417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787882795.822754:0:16359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787882795.822780:0:16359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5e0417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.822808:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a200/0xf4731e8a7c5e0410 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84354e expref: 32 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.822827:0:16359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5e0417 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84354e expref: 31 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.822848:0:16359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:2.0:1787882795.822913:0:16359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787882795.822918:0:16359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2a791be00, rc 0) 00000100:00100000:2.0:1787882795.823002:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+31:14535:x1874730542033664:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 473us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882795.823010:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:0.0:1787882795.827298:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882795.827385:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542033792 00000100:00100000:3.0:1787882795.827398:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542033792 00000100:00100000:3.0:1787882795.827617:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:3.0:1787882795.827630:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+6:2356:x1874730542033792:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787882795.827654:0:15168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787882795.827683:0:15168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e041e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a843555 expref: -99 pid: 15168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787882795.828019:0:15168:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a90ed2b, blocks: 0x1 00010000:00010000:3.0:1787882795.828044:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1787882795.828050:0:15168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882795.828064:0:15168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e041e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843555 expref: 7 pid: 15168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.828089:0:15168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e041e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843555 expref: 7 pid: 15168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.828106:0:15168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b7264200, rc 0) 00000100:00100000:3.0:1787882795.828192:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+7:2356:x1874730542033792:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 564us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882795.828201:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:2.0:1787882795.832691:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882795.832794:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542034048 00000100:00100000:1.0:1787882795.832807:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542034048 00000100:00100000:1.0:1787882795.832898:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:1.0:1787882795.832910:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+31:14535:x1874730542034048:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787882795.833129:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+31:14535:x1874730542034048:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 221us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882795.833139:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:0.0:1787882795.846152:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882795.846385:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542034176 00000100:00100000:1.0:1787882795.846398:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542034176 00000100:00100000:1.0:1787882795.846484:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:1.0:1787882795.846497:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+31:14535:x1874730542034176:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787882795.905255:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:2.0:1787882795.905283:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1787882795.905290:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:2.0:1787882795.905320:0:5873:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1787882795.905332:0:5873:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787882795.905653:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787882795.905691:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564034432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787882795.906538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882795.906582:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+14:14535:x1874730542034176:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 Request processed in 60082us (60438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882795.906595:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:1.0:1787882795.908118:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564034432 00000100:00100000:1.0:1787882795.908135:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564034432 00000100:00080000:3.0:1787882795.908229:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787882795.908240:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787882795.908253:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564034432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787882795.908838:0:15167:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787882795.908843:0:15167:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787882795.908846:0:15167:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787882795.908848:0:15167:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787882795 -> 1787882795 00002000:00010000:1.0:1787882795.908850:0:15167:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787882795.909130:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874730564034432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 867us (2998us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787882795.909141:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1787882795.909258:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fa2c1400e00/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787882795.909267:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564034432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787882795.915724:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882795.917468:0:16451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542034304 00000100:00100000:1.0:1787882795.917489:0:16451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542034304 00000100:00100000:2.0:1787882795.917752:0:16451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:2.0:1787882795.917778:0:16451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+7:2357:x1874730542034304:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787882795.917973:0:16451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+7:2357:x1874730542034304:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 Request processed in 209us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882795.917981:0:16451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:2.0:1787882795.927010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882795.932087:0:16359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542034560 00000100:00100000:0.0:1787882795.932109:0:16359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542034560 00000100:00100000:0.0:1787882795.932219:0:16359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:0.0:1787882795.932242:0:16359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+14:14535:x1874730542034560:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787882795.932315:0:16359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882795.932362:0:16359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791be00/0xf4731e8a7c5e0417 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84354e expref: 14 pid: 16359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.932388:0:16359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:0.0:1787882795.932395:0:16359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787882795.932439:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0425 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.932456:0:16359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0425 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.932468:0:16359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0425 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787882795.932815:0:16359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ca674a0 reply state 00000000ecd30edc transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0425 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882795.932827:0:16359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787882795.933049:0:16359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+15:14535:x1874730542034560:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 817us (6075us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787882795.933078:0:16359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00010000:00010000:3.0:1787882795.938222:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0425 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.938247:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0425 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.938256:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0425 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.938263:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6449e00 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:3.0:1787882795.938269:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0425 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.938276:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0425 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.938299:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:3.0:1787882795.938302:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787882795.938308:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0425 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882795.938314:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6449e00/0xf4731e8a7c5e0425 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882795.944442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882795.944559:0:15166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542034688 00000100:00100000:0.0:1787882795.944572:0:15166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542034688 00000100:00100000:0.0:1787882795.944643:0:15166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:0.0:1787882795.944655:0:15166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+7:14535:x1874730542034688:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787882795.944680:0:15166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787882795.944704:0:15166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2460e7d27a84355c expref: -99 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.944747:0:15166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e041e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843555 expref: 8 pid: 15168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.944756:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787882795.944761:0:15166:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882795.944767:0:15166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 8 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.944809:0:15166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e041e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843555 expref: 8 pid: 15168 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.944826:0:15166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e041e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843555 expref: 8 pid: 15168 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882795.944842:0:15166:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15166:1874730564034560:192.168.206.21@tcp:104: 00000100:00100000:0.0:1787882795.945005:0:15166:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa29832be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787882795.948573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882795.948830:0:15166:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15166:1874730564034560:192.168.206.21@tcp:104: 00010000:00010000:1.0:1787882795.948913:0:15166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 8 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882795.948942:0:15166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fa2b6448000, rc 0) 00000100:00100000:1.0:1787882795.949032:0:15166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+8:14535:x1874730542034688:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 4378us (4604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787882795.949062:0:15166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:2.0:1787882795.951351:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542034816 00000100:00100000:2.0:1787882795.951372:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542034816 00010000:00010000:2.0:1787882795.951441:0:14468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e041e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843555 expref: 8 pid: 15168 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882795.951505:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:0.0:1787882795.951532:0:14467:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787882795.951538:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+8:2357:x1874730542034816:12345-192.168.206.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787882795.951548:0:14467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787882795.951559:0:14468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882795.951591:0:14468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e041e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843555 expref: 8 pid: 15168 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.951608:0:14468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e041e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843555 expref: 8 pid: 15168 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.951641:0:14468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e041e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843555 expref: 8 pid: 15168 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.951666:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882795.951672:0:14468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882795.951681:0:14468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 7 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.951692:0:14468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 7 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.951741:0:14468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 7 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882795.951759:0:14468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14468:1874730564034688:192.168.206.21@tcp:105: 00000100:00100000:2.0:1787882795.951937:0:14468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a91eb240 going to sleep for 11 seconds 00000100:00100000:2.0:1787882795.959734:0:14468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14468:1874730564034688:192.168.206.21@tcp:105: 00010000:00010000:2.0:1787882795.959796:0:14468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787882795.959909:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+7:2357:x1874730542034816:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 8374us (11349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882795.959922:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:1.0:1787882795.960678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882795.960805:0:15168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542034944 00000100:00100000:3.0:1787882795.960816:0:15168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542034944 00000100:00100000:3.0:1787882795.961174:0:15168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:3.0:1787882795.961191:0:15168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+7:2359:x1874730542034944:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787882795.961529:0:15168:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787882795.961533:0:15168:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787882794 00002000:00010000:3.0:1787882795.961535:0:15168:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787882793 00002000:00010000:3.0:1787882795.961538:0:15168:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787882795 -> 1787882794 00002000:00010000:3.0:1787882795.961541:0:15168:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787882795.961627:0:15168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+8:2359:x1874730542034944:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 440us (951us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787882795.961637:0:15168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:3.0:1787882795.968204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882795.968925:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542035072 00000100:00100000:2.0:1787882795.968940:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542035072 00000100:00100000:2.0:1787882795.969030:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:2.0:1787882795.969042:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+8:2358:x1874730542035072:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787882795.969103:0:15167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.969130:0:15167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 8 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.969140:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787882795.969145:0:15167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882795.969151:0:15167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.969197:0:15167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 8 pid: 15166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.969213:0:15167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 8 pid: 15166 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882795.969230:0:15167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15167:1874730564034816:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882795.969365:0:15167:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a91eb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787882795.975497:0:15167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15167:1874730564034816:192.168.206.21@tcp:104: 00010000:00010000:0.0:1787882795.975538:0:15167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882795.980525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882795.980659:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542035200 00000100:00100000:2.0:1787882795.980672:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542035200 00010000:00010000:2.0:1787882795.980735:0:14469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 9 pid: 15166 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882795.980790:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:2.0:1787882795.980802:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+9:2357:x1874730542035200:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787882795.980822:0:14469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787882795.980854:0:14469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 9 pid: 15166 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.980919:0:14469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 9 pid: 15166 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.980950:0:14469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bab496e7/0xf4731e8a7c5e042c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84355c expref: 9 pid: 15166 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.980971:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882795.980977:0:14469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787882795.980985:0:14469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.981007:0:14469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882795.981060:0:14469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787882795.981273:0:15167:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.981283:0:15167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.981313:0:15167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.981324:0:15167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.981332:0:15167:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.981340:0:15167:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791ae00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882795.981345:0:15167:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.981355:0:15167:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.981377:0:15167:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882795.981385:0:15167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000905c33f7/0xf4731e8a7c5e0433 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882795.981474:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:24be1cef-979a-4c79-bf95-de3d76f61b96+8:2357:x1874730542035200:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 672us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882795.981483:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:0.0:1787882795.985161:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+7:2358:x1874730542035072:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 Request processed in 16102us (16953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882795.985181:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:2.0:1787882796.004331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882796.004448:0:15737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542035456 00000100:00100000:0.0:1787882796.004460:0:15737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542035456 00000100:00100000:0.0:1787882796.004548:0:15737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:0.0:1787882796.004562:0:15737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+14:14535:x1874730542035456:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787882796.004673:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448200/0xf4731e8a7c5e043a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.004695:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448200/0xf4731e8a7c5e043a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.004708:0:15737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448200/0xf4731e8a7c5e043a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.005391:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.005407:0:15737:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0409 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843547 expref: 15 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.005416:0:15737:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.005460:0:15737:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0409 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843547 expref: 15 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.005477:0:15737:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0409 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843547 expref: 15 pid: 14483 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882796.005492:0:15737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15737:1874730564034944:192.168.206.21@tcp:104: 00000100:00100000:2.0:1787882796.005603:0:15737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a91eb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787882796.008938:0:15737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15737:1874730564034944:192.168.206.21@tcp:104: 00010000:00010000:2.0:1787882796.008977:0:15737:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882796.012226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882796.012410:0:16713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542035584 00000100:00100000:0.0:1787882796.012424:0:16713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542035584 00010000:00010000:0.0:1787882796.012486:0:16713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0409 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843547 expref: 16 pid: 14483 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882796.012547:0:16713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:0.0:1787882796.012558:0:16713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+16:2357:x1874730542035584:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787882796.012577:0:16713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787882796.012586:0:16713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0409 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843547 expref: 16 pid: 14483 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.012601:0:16713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0409 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843547 expref: 16 pid: 14483 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.012627:0:16713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0409 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x2460e7d27a843547 expref: 16 pid: 14483 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.012646:0:16713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:0.0:1787882796.012653:0:16713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.012665:0:16713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.012673:0:16713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.012717:0:16713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787882796.012794:0:16713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+15:2357:x1874730542035584:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 237us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882796.012803:0:16713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00010000:00010000:1.0:1787882796.013551:0:15737:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.013566:0:15737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787882796.017845:0:15737:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787882796.021581:0:15737:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787882796.021699:0:15737:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787882796.021832:0:15737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15737:1874730564035072:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787882796.024663:0:15737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882796.024809:0:15737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa287dd16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787882796.036191:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564035072 00000100:00100000:3.0:1787882796.036207:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564035072 00000100:00100000:3.0:1787882796.036331:0:14487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787882796.036343:0:14487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15737:x1874730564035072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787882796.036485:0:14487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15737:x1874730564035072:12345-0@lo:1000:mdt00_003.0 Request processed in 145us (11830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787882796.036493:0:14487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787882796.036588:0:15737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15737:1874730564035072:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787882796.037367:0:15737:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787882796.037450:0:15737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b616b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15737:1874730564035200:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787882796.037510:0:15737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882796.045048:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564035200 00000100:00100000:2.0:1787882796.045053:0:15737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a91eb780 going to sleep for 11 seconds 00000100:00100000:0.0:1787882796.045063:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564035200 00000100:00100000:0.0:1787882796.045119:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787882796.045264:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:15737:x1874730564035200:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787882796.045536:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:15737:x1874730564035200:12345-0@lo:1000:mdt00_003.0 Request processed in 407us (8024us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787882796.045544:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787882796.047683:0:15737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b616b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15737:1874730564035200:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787882796.047746:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.047758:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.047852:0:15737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049257:0:15737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791a400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882796.049263:0:15737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049272:0:15737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049289:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:2.0:1787882796.049291:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787882796.049295:0:15737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049301:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791a400/0xf4731e8a7c5e0441 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049335:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049355:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049361:0:15737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049365:0:15737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264400 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:2.0:1787882796.049368:0:15737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049374:0:15737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049383:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:2.0:1787882796.049386:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787882796.049395:0:15737:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e03a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84352b expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049408:0:15737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e03a0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84352b expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049417:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e03a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84352b expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.049488:0:15737:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fa289fa7800/0xf4731e8a7c5e03a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x2460e7d27a84352b expref: 18 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882796.049501:0:15737:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b6168380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15737:1874730564035328:192.168.206.21@tcp:105: 00000100:00100000:2.0:1787882796.049609:0:15737:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fa2a91eb600 going to sleep for 11 seconds 00000100:00100000:3.0:1787882796.056238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882796.056448:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542035712 00000100:00100000:2.0:1787882796.056458:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542035712 00000100:00100000:2.0:1787882796.056517:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:2.0:1787882796.056528:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2bf777c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+19:14534:x1874730542035712:12345-192.168.206.21@tcp:49:dd.0 00000100:00100000:2.0:1787882796.056665:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2bf777c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+19:14534:x1874730542035712:12345-192.168.206.21@tcp:49:dd.0 Request processed in 138us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882796.056673:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:0.0:1787882796.060676:0:15737:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b6168380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15737:1874730564035328:192.168.206.21@tcp:105: 00010000:00010000:0.0:1787882796.060718:0:15737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060728:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b7264400/0xf4731e8a7c5e0399 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060818:0:15737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0448 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060831:0:15737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0448 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060842:0:15737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0448 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060853:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0448 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060908:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0448 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060913:0:15737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0448 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060919:0:15737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448600 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882796.060923:0:15737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0448 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060930:0:15737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0448 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060942:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:0.0:1787882796.060945:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787882796.060948:0:15737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0448 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060954:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448600/0xf4731e8a7c5e0448 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060965:0:15737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448200/0xf4731e8a7c5e043a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060976:0:15737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448200/0xf4731e8a7c5e043a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060981:0:15737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448200/0xf4731e8a7c5e043a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.060986:0:15737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448200 already unused, calling callback (ffffffffc1fdb4f0) 00010000:00010000:0.0:1787882796.061005:0:15737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448200/0xf4731e8a7c5e043a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.061011:0:15737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448200/0xf4731e8a7c5e043a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.061020:0:15737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fa283291700) 00010000:00010000:0.0:1787882796.061022:0:15737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787882796.061025:0:15737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448200/0xf4731e8a7c5e043a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.061031:0:15737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2b6448200/0xf4731e8a7c5e043a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15737 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882796.061275:0:15737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+18:14535:x1874730542035456:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 56715us (56957us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787882796.061287:0:15737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00000020:00080000:0.0:1787882796.061293:0:15737:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787882796.061515:0:14516:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787882796.061521:0:14516:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787882796.061544:0:14516:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787882796.061549:0:14516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787882796.064953:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882796.065091:0:14486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542035968 00000100:00100000:2.0:1787882796.065101:0:14486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542035968 00000100:00100000:2.0:1787882796.065145:0:14486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:2.0:1787882796.065155:0:14486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+18:14535:x1874730542035968:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787882796.065821:0:14486:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787882796.065980:0:14486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787882796.066040:0:14486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5e044f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.066057:0:14486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5e044f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.066069:0:14486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5e044f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.066077:0:14486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5e044f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.066094:0:14486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5e044f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.066100:0:14486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5e044f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.066124:0:14486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787882796.066228:0:14486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+20:14535:x1874730542035968:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 1071us (1282us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787882796.066237:0:14486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000020:00080000:2.0:1787882796.066243:0:14486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787882796.066391:0:14470:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787882796.066398:0:14470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5e044f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.066405:0:14470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2a791b600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882796.066409:0:14470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5e044f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.066417:0:14470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5e044f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.066429:0:14470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fa289160a00) 00010000:00010000:0.0:1787882796.066432:0:14470:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787882796.066443:0:14470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5e044f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.066450:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fa2a791b600/0xf4731e8a7c5e044f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.066462:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882796.066463:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787882796.066465:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882796.202112:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787882796.365445:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882796.367713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882796.372204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882796.372249:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542036096 00000100:00100000:0.0:1787882796.372261:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542036096 00000100:00100000:0.0:1787882796.372403:0:15171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542036352 00000100:00100000:0.0:1787882796.372407:0:15171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542036352 00000100:00100000:0.0:1787882796.372433:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:0.0:1787882796.372455:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+8:2359:x1874730542036096:12345-192.168.206.21@tcp:4:dd.0 00002000:00010000:0.0:1787882796.372511:0:15171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a90ed2a, atime: 0x6a90ed29, ctime: 0x6a90ed2a, blocks: 0x1 00010000:00010000:0.0:1787882796.372532:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5e0456 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.372551:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=512s v=(0 0) 00010000:00010000:0.0:1787882796.372557:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882796.372564:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5e0456 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.372579:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5e0456 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882796.377435:0:15173:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787882796.377451:0:15173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787882796.377687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1787882796.377777:0:15172:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787882796.377786:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542036224 00000100:00100000:1.0:1787882796.377794:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542036224 00000100:00100000:1.0:1787882796.377837:0:15172:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787882796.377845:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542036480 00000100:00100000:1.0:1787882796.377848:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542036480 00000100:00100000:0.0:1787882796.381236:0:16714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:0.0:1787882796.381256:0:16714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+11:2358:x1874730542036352:12345-192.168.206.21@tcp:4:dd.0 00010000:00010000:0.0:1787882796.381302:0:16714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5e045d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.381320:0:16714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882796.381324:0:16714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787882796.381330:0:16714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5e045d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.381343:0:16714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5e045d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882796.382956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882796.383142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882796.383409:0:15172:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787882796.400089:0:15172:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1787882796.400158:0:15173:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787882796.400174:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542036608 00000100:00100000:0.0:1787882796.400183:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542036608 00000100:00100000:0.0:1787882796.400234:0:15173:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787882796.400241:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542036736 00000100:00100000:0.0:1787882796.400244:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542036736 00000100:00100000:1.0:1787882796.400834:0:16715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:1.0:1787882796.400848:0:16715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+14:2358:x1874730542036224:12345-192.168.206.21@tcp:4:dd.0 00010000:00010000:1.0:1787882796.401184:0:16715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f5375e8/0xf4731e8a7c5e0464 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.401203:0:16715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882796.401207:0:16715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882796.401214:0:16715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f5375e8/0xf4731e8a7c5e0464 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.401228:0:16715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f5375e8/0xf4731e8a7c5e0464 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882796.401513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1787882796.401560:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882796.401564:0:15173:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787882796.401577:0:15173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1787882796.401634:0:15172:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1787882796.401645:0:15172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542036864 00000100:00100000:0.0:1787882796.401800:0:15173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542036992 00000100:00100000:0.0:1787882796.401807:0:15173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542036992 00000100:00100000:3.0:1787882796.402789:0:16716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:3.0:1787882796.402810:0:16716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:24be1cef-979a-4c79-bf95-de3d76f61b96+15:2359:x1874730542036480:12345-192.168.206.21@tcp:4:dd.0 00010000:00010000:3.0:1787882796.402843:0:16716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e046b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.402858:0:16716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882796.402862:0:16716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882796.402895:0:16716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e046b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.402909:0:16716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e046b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882796.403756:0:15172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542036864 00000001:00080000:2.0:1787882796.542794:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1787882796.542832:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1787882796.542898:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:3.0:1787882796.546106:0:16714:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1787882796.546119:0:16714:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787882794 -> 1787882795 00002000:00010000:3.0:1787882796.546123:0:16714:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787882794 -> 1787882795 00002000:00010000:3.0:1787882796.546125:0:16714:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 8199 00010000:00010000:3.0:1787882796.546147:0:16714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5e045d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.546164:0:16714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5e045d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.546175:0:16714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5e045d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.546216:0:16714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882796.546223:0:16714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5e045d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.546233:0:16714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5e045d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.546261:0:16714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5e045d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.546270:0:16714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7990252/0xf4731e8a7c5e045d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882796.546398:0:16714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+19:2358:x1874730542036352:12345-192.168.206.21@tcp:4:dd.0 Request processed in 165142us (178688us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787882796.546410:0:16714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:3.0:1787882796.546459:0:16714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:3.0:1787882796.546478:0:16714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+18:2359:x1874730542036608:12345-192.168.206.21@tcp:4:dd.0 00010000:00010000:3.0:1787882796.546522:0:16714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0472 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.546538:0:16714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882796.546543:0:16714:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882796.546550:0:16714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.546579:0:16714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.547467:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5e0456 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.547495:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5e0456 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.547504:0:15171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5e0456 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.547512:0:15171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b6448200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882796.547517:0:15171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5e0456 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.547525:0:15171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5e0456 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.547544:0:15171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5e0456 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.547552:0:15171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000924b0aa0/0xf4731e8a7c5e0456 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882796.547624:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+18:2359:x1874730542036096:12345-192.168.206.21@tcp:4:dd.0 Request processed in 175179us (182185us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787882796.547634:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:1.0:1787882796.547663:0:15171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:1.0:1787882796.547675:0:15171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+17:2359:x1874730542036736:12345-192.168.206.21@tcp:4:dd.0 00010000:00010000:1.0:1787882796.547701:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fda4701/0xf4731e8a7c5e0479 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.547718:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882796.547722:0:15171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882796.547727:0:15171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fda4701/0xf4731e8a7c5e0479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.547739:0:15171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fda4701/0xf4731e8a7c5e0479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787882796.616908:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1787882796.617636:0:16716:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00010000:00010000:1.0:1787882796.617661:0:16716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e046b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.617678:0:16716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e046b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.617688:0:16716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e046b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.617697:0:16716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264200 already unused, calling callback (ffffffffc159c230) 00010000:00010000:1.0:1787882796.617703:0:16716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e046b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.617712:0:16716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e046b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.617740:0:16716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e046b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.617775:0:16716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb14889a/0xf4731e8a7c5e046b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787882796.617948:0:16716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:24be1cef-979a-4c79-bf95-de3d76f61b96+17:2359:x1874730542036480:12345-192.168.206.21@tcp:4:dd.0 Request processed in 215137us (240257us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787882796.617960:0:16716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:1.0:1787882796.618015:0:16716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:1.0:1787882796.618030:0:16716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:24be1cef-979a-4c79-bf95-de3d76f61b96+16:2359:x1874730542036992:12345-192.168.206.21@tcp:4:dd.0 00010000:00010000:1.0:1787882796.618075:0:16716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078e2b050/0xf4731e8a7c5e0480 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.618089:0:16716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882796.618095:0:16716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787882796.618104:0:16716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078e2b050/0xf4731e8a7c5e0480 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787882796.618117:0:16716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078e2b050/0xf4731e8a7c5e0480 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.618782:0:16715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f5375e8/0xf4731e8a7c5e0464 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.618797:0:16715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f5375e8/0xf4731e8a7c5e0464 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.618804:0:16715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f5375e8/0xf4731e8a7c5e0464 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.618811:0:16715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6a00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882796.618814:0:16715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f5375e8/0xf4731e8a7c5e0464 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.618824:0:16715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f5375e8/0xf4731e8a7c5e0464 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.618842:0:16715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f5375e8/0xf4731e8a7c5e0464 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.618849:0:16715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f5375e8/0xf4731e8a7c5e0464 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882796.618943:0:16715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+16:2358:x1874730542036224:12345-192.168.206.21@tcp:4:dd.0 Request processed in 218095us (246747us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787882796.618960:0:16715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:3.0:1787882796.619001:0:16715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:3.0:1787882796.619012:0:16715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+15:2358:x1874730542036864:12345-192.168.206.21@tcp:4:dd.0 00010000:00010000:3.0:1787882796.619036:0:16715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a07884f/0xf4731e8a7c5e0487 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.619046:0:16715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882796.619050:0:16715:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787882796.619054:0:16715:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a07884f/0xf4731e8a7c5e0487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.619063:0:16715:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a07884f/0xf4731e8a7c5e0487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787882796.694225:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1787882796.694675:0:15171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1787882796.694681:0:15171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1787882796.694699:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fda4701/0xf4731e8a7c5e0479 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.694715:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fda4701/0xf4731e8a7c5e0479 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.694725:0:15171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fda4701/0xf4731e8a7c5e0479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.694749:0:15171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa6600 already unused, calling callback (ffffffffc159c230) 00010000:00010000:2.0:1787882796.694755:0:15171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fda4701/0xf4731e8a7c5e0479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.694776:0:15171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fda4701/0xf4731e8a7c5e0479 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.694800:0:15171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fda4701/0xf4731e8a7c5e0479 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787882796.694808:0:15171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fda4701/0xf4731e8a7c5e0479 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787882796.694969:0:15171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+15:2359:x1874730542036736:12345-192.168.206.21@tcp:4:dd.0 Request processed in 147289us (311818us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787882796.694980:0:15171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00010000:00010000:3.0:1787882796.695098:0:16714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0472 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.695109:0:16714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0472 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.695116:0:16714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0472 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.695123:0:16714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264000 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882796.695126:0:16714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0472 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.695147:0:16714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0472 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.695160:0:16714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0472 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.695168:0:16714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc7908bb/0xf4731e8a7c5e0472 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882796.695205:0:16714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:24be1cef-979a-4c79-bf95-de3d76f61b96+13:2359:x1874730542036608:12345-192.168.206.21@tcp:4:dd.0 Request processed in 148737us (312258us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787882796.695213:0:16714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00002000:00010000:3.0:1787882796.736308:0:16715:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1787882796.736337:0:16715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a07884f/0xf4731e8a7c5e0487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.736352:0:16715:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a07884f/0xf4731e8a7c5e0487 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.736362:0:16715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a07884f/0xf4731e8a7c5e0487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.736370:0:16715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa2b7264e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:3.0:1787882796.736376:0:16715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a07884f/0xf4731e8a7c5e0487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.736407:0:16715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a07884f/0xf4731e8a7c5e0487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.736433:0:16715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a07884f/0xf4731e8a7c5e0487 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787882796.736442:0:16715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a07884f/0xf4731e8a7c5e0487 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787882796.736554:0:16715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:24be1cef-979a-4c79-bf95-de3d76f61b96+11:2358:x1874730542036864:12345-192.168.206.21@tcp:4:dd.0 Request processed in 117538us (335035us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787882796.736567:0:16715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000001:00080000:0.0:1787882796.736660:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:0.0:1787882796.736677:0:6737:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1787882796.737350:0:16716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078e2b050/0xf4731e8a7c5e0480 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.737363:0:16716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078e2b050/0xf4731e8a7c5e0480 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.737381:0:16716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078e2b050/0xf4731e8a7c5e0480 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.737389:0:16716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fa289fa7e00 already unused, calling callback (ffffffffc159c230) 00010000:00010000:0.0:1787882796.737393:0:16716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078e2b050/0xf4731e8a7c5e0480 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.737401:0:16716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078e2b050/0xf4731e8a7c5e0480 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.737417:0:16716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078e2b050/0xf4731e8a7c5e0480 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787882796.737425:0:16716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078e2b050/0xf4731e8a7c5e0480 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787882796.737499:0:16716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2359:x1874730542036992:12345-192.168.206.21@tcp:4:dd.0 Request processed in 119471us (335936us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787882796.737508:0:16716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:3.0:1787882796.842461:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2b6169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564035456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787882796.842576:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787882796.843005:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564035456 00000100:00100000:2.0:1787882796.843018:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564035456 00000100:00100000:2.0:1787882796.843096:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787882796.843108:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2c1403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564035456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787882796.843162:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787882796.843236:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2c1403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874730564035456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787882796.843244:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787882796.843300:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2b6169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874730564035456:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787882796.843493:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787882796.845295:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564035584:0@lo:400:kworker.0 00000100:00100000:1.0:1787882796.845390:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787882796.845451:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787882796.845458:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730564035712:0@lo:400:kworker.0 00000100:00100000:1.0:1787882796.845491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882796.845900:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564035840:0@lo:400:kworker.0 00000100:00100000:0.0:1787882796.845942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882796.845978:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787882796.845995:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa2c1401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730564035968:0@lo:400:kworker.0 00000100:00100000:0.0:1787882796.846019:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882796.846052:0:14477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564035584 00000100:00100000:0.0:1787882796.846068:0:14477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564035584 00000100:00100000:0.0:1787882796.846122:0:14477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787882796.846132:0:14477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+19:3307:x1874730564035584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882796.846208:0:14477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfcc18db-0526-4071-939f-14c6713c8186+19:3307:x1874730564035584:12345-0@lo:400:kworker.0 Request processed in 76us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882796.846216:0:14477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787882796.846253:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564035712 00000100:00100000:0.0:1787882796.846257:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564035712 00000100:00100000:0.0:1787882796.846284:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564035840 00000100:00100000:0.0:1787882796.846287:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564035840 00000100:00100000:0.0:1787882796.846316:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564035968 00000100:00100000:0.0:1787882796.846319:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564035968 00000100:00100000:0.0:1787882796.846338:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787882796.846344:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b622c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730564035712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882796.846379:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b622c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874730564035712:12345-0@lo:400:kworker.0 Request processed in 35us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882796.846387:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787882796.846399:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787882796.846405:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564035840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882796.846435:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874730564035840:12345-0@lo:400:kworker.0 Request processed in 31us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882796.846441:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787882796.846453:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787882796.846459:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730564035968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787882796.846485:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874730564035968:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882796.846491:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787882796.846532:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787882796.846569:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1401180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874730564035968:0@lo:400:kworker.0 00000100:00100000:0.0:1787882796.846582:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874730564035840:0@lo:400:kworker.0 00000100:00100000:0.0:1787882796.846618:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1402680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874730564035712:0@lo:400:kworker.0 00000100:00100000:0.0:1787882796.846629:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa2c1403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bfcc18db-0526-4071-939f-14c6713c8186:3307:1874730564035584:0@lo:400:kworker.0 00010000:00010000:0.0:1787882797.226579:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787882798.250156:0:14471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787882798.350536:0:16754:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1787882798.382113:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fa29d8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564036096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787882798.382207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787882798.382334:0:15170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730564036096 00000100:00100000:0.0:1787882798.382344:0:15170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730564036096 00000100:00100000:0.0:1787882798.382421:0:15170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787882798.382433:0:15170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa29d8a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564036096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787882798.382482:0:15170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1787882798.382548:0:15170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa29d8a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874730564036096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882798.382556:0:15170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787882798.382582:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787882798.382622:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1787882798.382630:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fa2c1400e00, transno 8589934595 00000004:00080000:0.0:1787882798.382646:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1787882798.382686:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fa29d8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874730564036096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787882798.754602:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882798.754711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882798.754768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882798.754798:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882798.754818:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882798.754837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1787882798.754906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1787882798.755068:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542037632 00000100:00100000:0.0:1787882798.755081:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542037632 00000100:00100000:0.0:1787882798.755177:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542037248 00000100:00100000:0.0:1787882798.755180:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542037248 00000100:00100000:0.0:1787882798.755232:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:0.0:1787882798.755243:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:2358:x1874730542037632:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882798.755350:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0011688e-6324-4e6f-a6c4-bb79489cb0d9+6:2358:x1874730542037632:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 109us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882798.755358:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:0.0:1787882798.755378:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:0.0:1787882798.755386:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+20:2358:x1874730542037248:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882798.755415:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:24be1cef-979a-4c79-bf95-de3d76f61b96+20:2358:x1874730542037248:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882798.755421:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:0.0:1787882798.755446:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542037376 00000100:00100000:0.0:1787882798.755450:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542037376 00000100:00100000:0.0:1787882798.755472:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542037888 00000100:00100000:0.0:1787882798.755475:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542037888 00000100:00100000:0.0:1787882798.755488:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542037504 00000100:00100000:0.0:1787882798.755490:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542037504 00000100:00100000:0.0:1787882798.755504:0:15167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542037760 00000100:00100000:0.0:1787882798.755506:0:15167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542037760 00000100:00100000:0.0:1787882798.755522:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:0.0:1787882798.755528:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2358:x1874730542037376:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882798.755559:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6169f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2358:x1874730542037376:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882798.755565:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:0.0:1787882798.755577:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:0.0:1787882798.755592:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b6168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2358:x1874730542037888:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882798.755616:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b6168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2358:x1874730542037888:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882798.755630:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:0.0:1787882798.755642:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:0.0:1787882798.755648:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b616a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2358:x1874730542037504:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882798.755675:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b616a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:24be1cef-979a-4c79-bf95-de3d76f61b96+5:2358:x1874730542037504:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882798.755681:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:0.0:1787882798.755691:0:15167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:0.0:1787882798.755698:0:15167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b9875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2358:x1874730542037760:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882798.755723:0:15167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b9875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0011688e-6324-4e6f-a6c4-bb79489cb0d9+5:2358:x1874730542037760:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882798.755729:0:15167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00080000:2.0:1787882798.755941:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787882798.755947:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787882798.755950:0:14478:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787882798.757003:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874730542037120 00000100:00100000:1.0:1787882798.757016:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874730542037120 00000100:00100000:0.0:1787882798.757250:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:0.0:1787882798.757262:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fa2b554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:2358:x1874730542037120:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1787882798.757344:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fa2b554c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d82aa22-d25e-44d7-9348-ff42d56742a8+13:2358:x1874730542037120:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 85us (2757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787882798.757352:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 123 00010000:00010000:0.0:1787882799.274231:0:14470:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29390 lines, 29390 kept, 0 dropped, 0 bad.